-- Logs begin at Thu 2022-08-04 06:09:23 UTC, end at Thu 2022-08-04 07:43:50 UTC. -- Aug 04 06:41:54.202727 dv-cinder-826608-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 06:41:54.210516 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 06:41:54 2022] *** Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: nodename: dv-cinder-826608-7-iscsi Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: machine: x86_64 Aug 04 06:41:54.212504 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: clock source: unix Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: pcre jit disabled Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: detected number of CPU cores: 4 Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: current working directory: / Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: detected binary path: /usr/bin/uwsgi-core Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: your processes number limit is 47680 Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: your memory page size is 4096 bytes Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: detected max file descriptor number: 2048 Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: lock engine: pthread robust mutexes Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: thunder lock: enabled Aug 04 06:41:54.212880 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 06:41:54.215136 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 06:41:54.252854 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: Python main interpreter initialized at 0x556d02d2f9c0 Aug 04 06:41:54.252854 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: python threads support enabled Aug 04 06:41:54.252854 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: your server socket listen backlog is limited to 100 connections Aug 04 06:41:54.252854 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: your mercy for graceful operations on workers is 90 seconds Aug 04 06:41:54.253251 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 06:41:54.253325 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: *** Operational MODE: preforking *** Aug 04 06:41:54.253591 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: *** uWSGI is running in multiple interpreter mode *** Aug 04 06:41:54.253591 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: spawned uWSGI master process (pid: 80202) Aug 04 06:41:54.253793 dv-cinder-826608-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 04 06:41:54.254849 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: spawned uWSGI worker 1 (pid: 80212, cores: 1) Aug 04 06:41:54.254849 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: spawned uWSGI worker 2 (pid: 80213, cores: 1) Aug 04 06:41:54.254849 dv-cinder-826608-7-iscsi devstack@keystone.service[80202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 06:41:59.758261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 06:41:59.758261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: from cryptography.utils import int_from_bytes Aug 04 06:41:59.758938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 06:41:59.758938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: from cryptography.utils import int_from_bytes Aug 04 06:41:59.760738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 06:41:59.760738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Aug 04 06:41:59.761221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 06:41:59.761221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Aug 04 06:41:59.808691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 06:41:59.808878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 06:41:59.808967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 06:41:59.809088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] command line args: [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 06:41:59.809168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 06:41:59.809328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 06:41:59.809420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] command line args: [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 06:41:59.809497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ================================================================================ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 06:41:59.809601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 06:41:59.809748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] admin_token = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.809824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ================================================================================ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 06:41:59.809987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] config_dir = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] config_dir = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] config_source = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] debug = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] config_source = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.810724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] debug = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.811929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_config_append = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_config_append = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_dir = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.812923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_dir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.813894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.814908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.815993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.816917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] publish_errors = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] publish_errors = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.817866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] standard_threads = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] standard_threads = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.818936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] use_journal = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] use_json = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] use_stderr = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] use_journal = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] use_syslog = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] use_json = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] use_stderr = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.819981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] use_syslog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.820212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 06:41:59.820463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.820936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.821977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.822924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.823849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.824969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.825991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.826973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.827148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.827270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.827350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.827430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.828917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.829943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.830927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.831983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.832904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.833939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.834987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.835960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.836938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.837884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.838977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.839968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.840916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.841997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.842902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.843228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.843944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.844907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.external = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.845956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.password = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.token = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.846937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.external = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.847856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.password = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.token = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.848946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.849998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.850885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.851952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.852898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.853876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.854976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.855928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.856933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.857885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.858897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.859888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.860891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.861866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.862950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.863942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.864942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.865970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.866986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.867988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.868860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.869888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870257 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.870883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.871904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.872911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.873905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.874947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.875952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.876933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.877958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.878948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] role.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] role.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.879946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.880886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.881934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] role.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] role.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.882938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.883941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.884940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.885936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.886904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.887959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.888929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.889923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.890056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.890689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.890814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.890939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.891941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.892943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.893963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.894956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.895968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.896952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.897596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.898128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.898128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.898128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 06:41:59.898128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 06:41:59.923944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.924163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.924383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.926059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.926290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.926513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.932614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.934752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.962782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.962949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.963298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:41:59.963532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.015914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.016308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.067011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.067238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.067729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.067968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.132350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.132572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.132790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.132875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.133964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.156724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.156945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.157971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.158052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.158184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.158399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.168822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.169139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.181486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.181650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.181737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.181883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.181965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.182908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 06:42:00.200356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.200562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 06:42:00.200653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.200852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 06:42:00.200935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 06:42:00.201209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 06:42:00.201624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.201958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.202119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.202198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.202373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.212353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.212622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.212705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.212924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.213031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.213180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.213262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.213458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.220764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.221525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.225418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.225693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.225965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.226217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.226304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.226495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.226590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.226746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.226826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.227879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.228046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.228125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.228311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.228578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.228841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.251319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.252781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.252865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.253077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.254371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.254648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.257972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.258248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.258526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.259234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.259511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.259789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.265336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.265621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.266765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.267041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.269684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.269966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.270242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.270520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.270790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.271075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.271345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.271608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.272112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.272405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.272684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.272971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.273278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.273566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.273835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.274100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.289963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.290233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.291333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.291610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.294115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.295515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.297288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.297577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.299090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.299382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.301914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.303755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.305363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.306952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.308472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.308764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.309071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.309351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.309622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.309911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.310130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.310423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.310704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.310991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.311267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.311553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.326445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.326722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.326981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.327243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.328640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.328924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.329216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.329490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.334225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.335758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.336028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.336281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.337886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.338164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.338840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.339118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.339395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.339667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.339933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.340969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.341278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.341569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.341851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.342129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.352112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.352384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.352656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.352930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.353226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.353494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.353768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.354532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.354809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.355086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.355361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.355634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.355904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.356195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.369680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.372306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.372638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.375794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.375939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.378313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.378751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.379798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.380083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.380360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.381240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.382771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.383070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.383357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.387012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.388592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.389777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.392010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.392178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.392274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.392555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.392823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.395129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.395419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.395698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.395969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.400787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.401094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.401373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.403959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.404254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.404532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.408431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.408714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.409004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.409281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.409547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.409811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.410087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.410347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.410735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.410999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.411274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.411531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.411738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 06:42:00.411818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.412017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.412100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.412295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.412565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.412832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.413125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.413395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.413674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.414054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.414315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.414592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.414850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.415376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 06:42:00.445855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d02d2f9c0 pid: 80212 (default app) Aug 04 06:42:00.449142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330adb4-657e-464b-8b49-0ba5eb3c76cd None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:00.449428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330adb4-657e-464b-8b49-0ba5eb3c76cd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:00.449683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d02d2f9c0 pid: 80213 (default app) Aug 04 06:42:00.449764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330adb4-657e-464b-8b49-0ba5eb3c76cd None None] PATH_INFO: `/v3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:00.454474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Aug 4 06:42:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:08.114205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:08.114758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:08.114758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:08.119150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:08.125155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:08.125561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:08.125690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:08.195620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: INFO dbcounter [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] Registered counter for database keystone Aug 04 06:42:08.214408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG oslo_db.sqlalchemy.engines [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 06:42:08.221282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writer thread running {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 06:42:08.405893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG passlib.handlers.bcrypt [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80212) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 06:42:08.406230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG passlib.handlers.bcrypt [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80212) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 06:42:08.460157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:08.461866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:08.590981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 06:42:08.714629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:08.784458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: INFO dbcounter [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] Registered counter for database keystone Aug 04 06:42:08.805176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG oslo_db.sqlalchemy.engines [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 06:42:08.811283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writer thread running {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 06:42:08.928646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6081-82e7-42b1-b20e-e154d2101b94 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:08.932883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:08.933540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:08.933825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:08.934099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:08.942302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:08.994434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 06:42:08.994721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27a939-ad7f-49f0-bfc2-fd69134df911 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:09.004670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Aug 4 06:42:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:42:09.010584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:09.025208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a5fe-00a3-46e6-bb9e-953e33aea283 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:09.029450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:09.030596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:09.030874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:09.031150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] PATH_INFO: `/v3/projects/0cb3b87528e24f6496c89253b8f1df0e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:09.032607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] RBAC: Authorizing `identity:get_project(project_id=0cb3b87528e24f6496c89253b8f1df0e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:09.083674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 06:42:09.084008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49d48-9103-4d3f-9c50-a313ee49aa8c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:09.088593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Aug 4 06:42:09 2022] GET /identity/v3/projects/0cb3b87528e24f6496c89253b8f1df0e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:11.097231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb589-1fe5-4bfe-89e9-46ecda432c4b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:11.097728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb589-1fe5-4bfe-89e9-46ecda432c4b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:11.097836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb589-1fe5-4bfe-89e9-46ecda432c4b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:11.101871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:11.107141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:11.107518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:11.107690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:11.128304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:11.129855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:11.137510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 06:42:11.159224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb589-1fe5-4bfe-89e9-46ecda432c4b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:11.171670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb589-1fe5-4bfe-89e9-46ecda432c4b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:11.176047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:11.176671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:11.176955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:11.177261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:11.184939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:11.187300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd23a9-6132-472e-aef4-215264e99373 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:11.195939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Aug 4 06:42:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:42:11.201061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:11.209796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ccedc-8d58-4520-ac3e-bd588c238fca None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:11.214017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:11.214630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:11.214906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:11.215177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:11.216506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:11.218833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391eeb-b25b-4be2-afef-eeb9bd4a35a2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:11.220338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Aug 4 06:42:11 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:13.290790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9274e3-b09b-4fd3-b0ea-137b81ce3ff3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.291327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9274e3-b09b-4fd3-b0ea-137b81ce3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.291327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9274e3-b09b-4fd3-b0ea-137b81ce3ff3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.292643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:13.297741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.298161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.298293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.305520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd394-9d4d-40a0-8432-7927ba52a559 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.305807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd394-9d4d-40a0-8432-7927ba52a559 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.306086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd394-9d4d-40a0-8432-7927ba52a559 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.307381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:13.312829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.313160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.313447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.319813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:13.320997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:13.355853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80213) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 06:42:13.356422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80213) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 06:42:13.399771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:13.401930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:13.403520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:13.422893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:13.445934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:13.505053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:13.526669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b3332-ec65-40e6-a737-a19604e53d9b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:13.526996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:13.559495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:13.560141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.560416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.560688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.572011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:13.581397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:13.582349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:13.583166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:13.589662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:13.624592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4bf4-2012-4be2-875b-42ae2d34667f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:13.626871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:13.662542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:13.663404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.663684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.663957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.670357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:13.690632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf358aa-b407-4dfe-8dcb-f208beba5936 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:13.724152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:13.724763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.725067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.725340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.726048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:13.726339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:13.727720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:13.732699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:13.734869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:13.739843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:13.745682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:13.838123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:42:13.844438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:13.847060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:13.847497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d076-5062-41c4-bd85-eb18a09c0584 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:13.945917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b005cf-8c54-47a3-b2ee-ba718d36fcd4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:13.981935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:13.982799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.983125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.983390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.988146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:13.988786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:13.989088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:13.989368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:13.990533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:13.991967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:13.993579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:13.999079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:14.001570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:14.003087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:14.013818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:42:14.021535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:14.022369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:14.023336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:42:14.023336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:42:14.023336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:42:14.023336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:14.023336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:14.028453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:14.082501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:14.099600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be320-6037-46b4-9e5f-5ee7dd2e745d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:14.126166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4b3a-7fa5-4d01-86cf-227520772bce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:14.132335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:14.132974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:14.133272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:14.133539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:14.134677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:14.136109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:14.137693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:14.144252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:14.160082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:14.160701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:14.160993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:14.161269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:14.161947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:14.162247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:14.163616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5b8c-bf2d-4b82-8e75-732a87e65945 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:14.180606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:14.227178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:14.248003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0861-0f0e-4b7e-a4a9-ea8bf72598a2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:14.284626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:14.285298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:14.285583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:14.285860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:14.286661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.domain.id=default, user.id=ab9d252f59de4268acb7a07e5f3ccbd8) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:14.286971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:14.288445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2cf3e-3984-4424-9161-5f4fd46bd10e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:14.296253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Aug 4 06:42:14 2022] GET /identity/v3/role_assignments?user.id=ab9d252f59de4268acb7a07e5f3ccbd8&scope.domain.id=default&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:16.589485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8d24-f67c-463b-9ff6-8dc5cbe11c13 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.590338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8d24-f67c-463b-9ff6-8dc5cbe11c13 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.590774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8d24-f67c-463b-9ff6-8dc5cbe11c13 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.593050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:16.608875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a591-5d35-4a8c-9eb9-54b71b81aea4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.609701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a591-5d35-4a8c-9eb9-54b71b81aea4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.610125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a591-5d35-4a8c-9eb9-54b71b81aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.635824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bd11a591-5d35-4a8c-9eb9-54b71b81aea4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:16.637277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bd11a591-5d35-4a8c-9eb9-54b71b81aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:16.658631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f3dc-66f1-4b7d-9f16-249c3bce83aa None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.659063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f3dc-66f1-4b7d-9f16-249c3bce83aa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.659440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f3dc-66f1-4b7d-9f16-249c3bce83aa None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.660886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:16.666282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297a75-b931-447d-a1ec-0a37312a8a3e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.666669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297a75-b931-447d-a1ec-0a37312a8a3e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.667039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60297a75-b931-447d-a1ec-0a37312a8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.694949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-60297a75-b931-447d-a1ec-0a37312a8a3e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:16.698949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60297a75-b931-447d-a1ec-0a37312a8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:16.803088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:16.804367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522fa6-940f-463c-8f22-3f6b39f24f8c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.804653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522fa6-940f-463c-8f22-3f6b39f24f8c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.804927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522fa6-940f-463c-8f22-3f6b39f24f8c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.809291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:16.810810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 13/26] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:16.824643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:16.825184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:16.825604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:16.843945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2522fa6-940f-463c-8f22-3f6b39f24f8c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:16.866069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:16.867255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:16.940433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:16.980431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:16.981984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2522fa6-940f-463c-8f22-3f6b39f24f8c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.032130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:17.033259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.058138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.059127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.060593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.061581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.083965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:17.085842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:42:17.118672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:17.119697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:17.120706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:42:17.120706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:42:17.120706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:42:17.120706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:17.122397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:17.124061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.229098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b26338-b474-4b3d-b422-b1fea7c23639 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.291916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.292807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.293418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.294825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.295795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:17.297467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:17.315421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16311da0-6484-420e-9d47-f1d4552e86c2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.351291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:17.363706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.364667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.365141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.365606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.379671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:17.387201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:17.388116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:17.388897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:17.391971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:17.398324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.511189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b27e-a841-4118-8262-e6844f409e5d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.550786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.551404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.551682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.551955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.552644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:17.552942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:17.554339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0282192-3f41-4cd8-9744-e0d996f8928e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:17.572669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 16/30] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:17.573921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3720d1-c9ee-4223-a3f6-b3a020c946fa None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.574205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3720d1-c9ee-4223-a3f6-b3a020c946fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.574476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3720d1-c9ee-4223-a3f6-b3a020c946fa None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.575730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 17/31] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:17.579817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3720d1-c9ee-4223-a3f6-b3a020c946fa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.589216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 15/32] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 06:42:17 2022] POST /identity/v3/roles => generated 219 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:17.590507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.632439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:17.643022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:17.720411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3720d1-c9ee-4223-a3f6-b3a020c946fa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.774027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.775067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.775533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.776181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.777478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:17.777987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:17.780297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869a87-48da-4b85-a296-8f07e7a88c8b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:17.793425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 18/33] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:17.794200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ef24-3077-4aa6-985f-b8a7833aa0e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:17.795085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b325-dca2-41ea-9061-a8b60a59d4c9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.796613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b325-dca2-41ea-9061-a8b60a59d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.797185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b325-dca2-41ea-9061-a8b60a59d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.822421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f933b325-dca2-41ea-9061-a8b60a59d4c9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:17.823624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f933b325-dca2-41ea-9061-a8b60a59d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:17.837626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:17.838269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.838551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.838822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.840119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:17.841582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd14cc0-0c5e-4b54-a46d-9458870cd0df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:17.876678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 16/34] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:42:17 2022] POST /identity/v3/projects => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:17.878063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723636-2776-4866-b738-c8b358b2d60c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.878698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723636-2776-4866-b738-c8b358b2d60c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.878698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723636-2776-4866-b738-c8b358b2d60c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.880069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 17/35] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:17.880640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723636-2776-4866-b738-c8b358b2d60c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:17.915155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:17.916823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:17.917349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:17.917932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:17.939628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:17.941338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:17.979281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:17.994080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:18.011562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723636-2776-4866-b738-c8b358b2d60c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.037032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 20/37] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:18.038195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.064450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.065104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.065876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.066212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.067986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.070038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.071682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 18/38] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:17 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:18.072438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.161638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5c339-4bba-42a7-8e9a-d52851f87256 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.182218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218a8b5-5786-45df-ba79-4c031fb4a9d2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.196560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.197202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.197482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.197761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.198459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.199832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e732f07-fb18-4d70-af03-611452a3ff07 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.216260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.216905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.218334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.218783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.219953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.221429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.223003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 19/39] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:18.223752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.249131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:18.319066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 06:42:18 2022] POST /identity/v3/roles => generated 225 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:18.320509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413bc8-ccd1-484a-9b46-f873c91bc943 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.320801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413bc8-ccd1-484a-9b46-f873c91bc943 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.321108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413bc8-ccd1-484a-9b46-f873c91bc943 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.322353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 22/41] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:18.323052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413bc8-ccd1-484a-9b46-f873c91bc943 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.336550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041f2a-0b53-4150-a9f9-4c05dd2e2ebf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.358446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:18.378930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.379614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.379897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.380169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.381456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.383293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca010-5cd8-4796-9a3b-4f40bce452c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.390094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 20/42] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:18.390094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.390094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.390094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.407953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:18.409904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:18.466358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413bc8-ccd1-484a-9b46-f873c91bc943 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.488546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 21/43] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:18.488546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.504499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.505158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.505444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.508573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.508573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.509119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.518572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:18.542133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:42:18 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:18.543255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:18.616753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2094-1411-40ef-a06b-100d7aa21dc8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.632794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:18.655996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49a85-b498-4856-b579-007c60d8cd4a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:18.660804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.661562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.661851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.662147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] PATH_INFO: `/v3/domains/default/users/ab9d252f59de4268acb7a07e5f3ccbd8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.664286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab9d252f59de4268acb7a07e5f3ccbd8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.665807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605018-0ec9-4353-889d-20ae4d8e0048 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.686799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Aug 4 06:42:18 2022] PUT /identity/v3/domains/default/users/ab9d252f59de4268acb7a07e5f3ccbd8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:18.715419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:18.716071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:18.716351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:18.716674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:18.717751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:18.719196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57248dd0-eefa-4729-9ee4-768783063e79 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:18.735559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 06:42:18 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:20.596307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4ecc-0d2a-4438-8406-07d89ee6ee76 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.596822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4ecc-0d2a-4438-8406-07d89ee6ee76 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.596902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab4ecc-0d2a-4438-8406-07d89ee6ee76 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.598249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 23/47] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:20.603357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392cf-dcf6-4927-9e75-66f8ac4aa6b2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.603775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392cf-dcf6-4927-9e75-66f8ac4aa6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.603905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0392cf-dcf6-4927-9e75-66f8ac4aa6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.622690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9a0392cf-dcf6-4927-9e75-66f8ac4aa6b2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:20.624407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9a0392cf-dcf6-4927-9e75-66f8ac4aa6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:20.693012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:20.705350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f3f3-0235-4ba7-bef3-b546b1e94a53 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.705710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f3f3-0235-4ba7-bef3-b546b1e94a53 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.706053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f3f3-0235-4ba7-bef3-b546b1e94a53 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.707604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 24/49] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:20.712566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.712903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.713229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.715402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f3f3-0235-4ba7-bef3-b546b1e94a53 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:20.731316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:20.732524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:20.797199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:20.801203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:20.806759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 26/50] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:20.816966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f3f3-0235-4ba7-bef3-b546b1e94a53 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:20.829497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:20.852852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:20.853460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.853742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.854015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.855161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:20.856607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:20.858426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 25/51] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:20.864021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:20.925007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ac6d6-25a7-4352-bb74-c20929eeb61b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:20.958008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:20.958642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:20.958919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:20.959193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:20.959922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed265ad-2363-4fed-9242-49532b0ceb84 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:20.969651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:20.974492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:20.975364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:20.976142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 27/52] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:20.982299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:21.000260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:21.000887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:21.001206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:21.001491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:21.002176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:21.003627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:21.032023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 26/53] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Aug 4 06:42:20 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:42:21.043604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:21.091240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1293-244d-494c-87c0-c60abe605eb5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:21.139817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:21.140429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:21.140713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:21.141078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:21.141750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:21.142056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:21.143482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:21.152686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 28/54] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:21.159352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:21.162327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:21.262200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1bda5-0300-4abe-b50d-9ad302e2c3c0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:21.295850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:21.296501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:21.296785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:21.297252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:21.298444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:21.299891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:21.301529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:21 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:21.307282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:21.410119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ac9ca-7cba-43f3-a14c-4f351e3a9d6e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:21.431615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:21.443655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:21.444293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:21.444572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:21.444845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:21.446016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:21.447460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb226a-0f44-4ed0-ab71-c163172ded54 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:21.449041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 29/56] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:21.455533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:21.523748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:21.554780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a67b-6900-4174-a0b5-5288ec67abc5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:21.587616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:21.588238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:21.588521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:21.588801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:21.589625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.domain.id=default, user.id=ab9d252f59de4268acb7a07e5f3ccbd8) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:21.589935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:21.591373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0af1df-5427-4dcb-bc17-64a1035ddd9c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:21.599975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Aug 4 06:42:21 2022] GET /identity/v3/role_assignments?user.id=ab9d252f59de4268acb7a07e5f3ccbd8&scope.domain.id=default&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:23.033111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bcdf-e637-4fd7-ace1-c349b55aadaf None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:23.033592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bcdf-e637-4fd7-ace1-c349b55aadaf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:23.033592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bcdf-e637-4fd7-ace1-c349b55aadaf None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:23.034948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 30/58] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:23.040032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:23.040395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:23.040591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:23.058737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:23.059899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:23.122589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:23.146919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6bcdf-e637-4fd7-ace1-c349b55aadaf None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:23.245885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6bcdf-e637-4fd7-ace1-c349b55aadaf None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:23.278577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:23.279727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:23.280020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:23.280294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:23.281533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:23.282993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364e789-40ba-4f51-a414-dc9e00c3ac1e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:23.284593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 31/60] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:23.289972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:23.348386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:23.384252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a67b-8d7d-4a46-b792-a64f350c0374 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:23.416236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:23.416838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:23.417146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:23.417420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:23.418099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:23.419533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b8585-b82e-4f75-9661-aad5969f1377 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:23.444739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 30/61] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:23 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:26.717015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51858-33a9-468c-ad7b-0225f3b77081 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.717755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51858-33a9-468c-ad7b-0225f3b77081 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.717994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51858-33a9-468c-ad7b-0225f3b77081 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.719363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 32/62] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:26.729033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea36c0-cbb7-40f9-925f-6a2c495c98f1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.729972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea36c0-cbb7-40f9-925f-6a2c495c98f1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.730451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea36c0-cbb7-40f9-925f-6a2c495c98f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.757986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e9ea36c0-cbb7-40f9-925f-6a2c495c98f1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:26.759507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e9ea36c0-cbb7-40f9-925f-6a2c495c98f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:26.829440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8bde-52db-45f0-a072-499819f0ae30 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.830094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8bde-52db-45f0-a072-499819f0ae30 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.830625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8bde-52db-45f0-a072-499819f0ae30 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.832195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 33/63] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:26.838115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.838656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.839133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.856586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:26.858188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a925-c751-48b8-82be-35e2f0747320 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.858479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a925-c751-48b8-82be-35e2f0747320 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.858758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a925-c751-48b8-82be-35e2f0747320 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.860416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:26.861872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:26.864354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 32/65] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:26.867115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38dc13-b0c4-4dcc-bb32-f6aacf5f0628 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.867402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38dc13-b0c4-4dcc-bb32-f6aacf5f0628 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.867681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38dc13-b0c4-4dcc-bb32-f6aacf5f0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.886572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9c38dc13-b0c4-4dcc-bb32-f6aacf5f0628 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:26.888068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9c38dc13-b0c4-4dcc-bb32-f6aacf5f0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:26.932972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:26.949075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 34/66] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:26.949242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:26.956881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:26.976875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 33/67] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:26.979568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0337d-f59b-42da-b614-cfa40c61d87d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:26.979862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0337d-f59b-42da-b614-cfa40c61d87d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:26.980141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0337d-f59b-42da-b614-cfa40c61d87d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:26.981847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 34/68] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:26.982543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0337d-f59b-42da-b614-cfa40c61d87d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.083540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0a21-ca7d-4e32-ae8f-8ff05ffb732e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.097116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0337d-f59b-42da-b614-cfa40c61d87d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.118767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.119408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.119687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.119960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.130763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:27.132752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.133424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.133710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.133990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-70bd8f80-d065-4062-817f-30bff8dee35c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:27.135590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:27.136395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:27.137404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:27.142267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379044-d74f-4783-90d1-eabe4366b50d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.142635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379044-d74f-4783-90d1-eabe4366b50d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.142925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379044-d74f-4783-90d1-eabe4366b50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.146321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:27.152867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:27.153866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:27.154692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:27.155273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 35/70] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:27.155586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.162479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2f379044-d74f-4783-90d1-eabe4366b50d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:27.163691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2f379044-d74f-4783-90d1-eabe4366b50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:27.197158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.209911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.233549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:27.234928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b820-5a0b-47e4-a4ca-f10e24686791 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.235222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b820-5a0b-47e4-a4ca-f10e24686791 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.235502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b820-5a0b-47e4-a4ca-f10e24686791 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.236757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 37/72] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:27.237488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b820-5a0b-47e4-a4ca-f10e24686791 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.266215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16621-d725-49da-af59-583a9b68300e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.299132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.299778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.300065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.300343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.310655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:27.316202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:27.317171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:27.318232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:27.318884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.346923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b820-5a0b-47e4-a4ca-f10e24686791 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.382087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.382710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.382994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.383273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.383989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:27.384294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.385705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea189e-9ee8-4cd5-a9c8-48e8dde20810 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.393893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.395051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.395339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.395622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.412573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:27.413781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:27.417852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.421701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a44db-d5c3-4fd2-b7b0-59be7b551bff None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.448095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.456549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.457203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.457489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.457763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.458472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:27.458775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.460209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.472735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.473620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.481883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:27.483241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.579595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba63-d55e-42e6-9d54-98c5914455b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.585030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865a5a8-fe9f-4f49-9687-a9b71763405c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.613117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.613754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.614036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.614309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.615464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.616914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.618516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 38/77] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.619814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.620438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.620719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.621012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.621729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:27.622033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.624462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.624643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.632806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 40/78] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.633623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.656481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.666006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.729361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0edd7-86c8-40e3-b1ab-ebf43df42bf8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.740693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1303d0-9c3b-4959-b27b-25f0e60c1d60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.762098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.762741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.763024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.763361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.773291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.773918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.774194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.774463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.775612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.777096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.778207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.778673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 41/79] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.786990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.787075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.787075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 39/80] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:27.787075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.868888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.879144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:27.882046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eb615-f99d-456a-b55c-2c821262bc67 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.882242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f186eb4-5d47-45c0-b340-ee96f9ebaf09 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:27.922348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.922987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.923118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:27.923273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.923549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.923769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:27.924056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:27.924228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:27.924334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:27.925705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:27.934837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:27.940799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:27.941801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:27.942622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 42/81] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:27.943271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:27.948513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 40/82] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:27 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:27.948513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.062503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ea5-a2f6-4c6b-a94c-1d29b7a2d299 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.062921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326f61-c4ab-4e0d-a4a7-5e160e67102d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.104179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.105237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.105237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.105411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.106641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.109117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.110815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.110936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 43/83] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:28.111005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.111069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.111337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.115399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.128008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.146780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.194688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.196181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.240187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea1261-78e4-44ec-bd6e-012a3027a4e7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.279647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.280285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.280572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.280848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.329553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 41/84] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:28.330199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.364315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.365839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.395669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.401742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.474109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119189d1-9708-4e48-9fe5-7e4e3d083141 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.479158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:28.480103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.526413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.527073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.527800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.528100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.528821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:28.529244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.530996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.542717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 42/86] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:28.543912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.591750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa33af-0c03-40a4-8bfe-9bc955f7a3cf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.621422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.633360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.634312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.634787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.635250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.673596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ab02-a2ca-44c1-a9fa-21f008c8f638 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.683469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.718808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.719676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.720103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.720547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.721972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.723662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.725692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 43/87] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:28.726773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.736158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.738175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.835096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad1ea-d173-44d0-ab27-137f10f97e81 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.853876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 45/88] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:28.854644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.873948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.874943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.875481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.875957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.877372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:28.879248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:28.881529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 44/89] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:28.882520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:28.889367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.931950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:28.961935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443413a-1d4a-4f65-b79e-9e6b6463c38d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.996515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:28.997183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:28.997464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:28.997769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:28.998346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890ebc-863c-41e4-b46e-f108663e3e01 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:28.998947 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.000375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.002079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 46/90] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.002721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.038330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.039296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.039806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.040308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.042399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:29.042964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.044830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.051674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 45/91] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:28 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=b145351ec6374b099e83fb311cea5308 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.052766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.103622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:29.110757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ada524-49fa-47ac-b264-37c223b414ad None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.147237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.148049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.148427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.148799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.150132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.151759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.154245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.155099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.179828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2c53-d29e-4b54-9c34-d2e765e0e2bd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.189171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:29.225011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.226035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.226504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.226958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.228056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=ab9d252f59de4268acb7a07e5f3ccbd8) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:29.228577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.230472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.237575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 46/93] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/role_assignments?user.id=ab9d252f59de4268acb7a07e5f3ccbd8&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.238793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.265424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0379e3-8588-4771-807c-d2a5f9728977 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.304302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.304935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.305243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.305532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.339082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:29.368518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32fb1-2215-4ac5-9622-63d84d621d01 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.383249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.384673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.413695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.414697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.416458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.417048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.418192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:29.418510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.420384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.427297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=89195211fe574d2f96f793a39364ed4d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.516712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:29.522619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.577239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:29.672347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546c8fc-2ce1-41e2-bc51-84b8e5c15dc6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.721242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.721919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.722207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.722489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] PATH_INFO: `/v3/projects/e1c3300c8ec741fab665c6f998ee91af` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.723705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c3300c8ec741fab665c6f998ee91af)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.725197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fc986-ba20-4b8c-8e98-5f6762dd9eb8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.726909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/projects/e1c3300c8ec741fab665c6f998ee91af => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:29.733759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:29.826302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:29.871684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86c22-47e7-4dc3-b515-8d8f49f4117c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:29.914302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:29.915356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:29.915846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:29.916319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:29.917326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=e1c3300c8ec741fab665c6f998ee91af, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:29.917827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:29.920102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56a810-ee1d-42d3-b8c8-17744ab3014c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:29.929364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 49/97] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:29 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=e1c3300c8ec741fab665c6f998ee91af&role.id=89195211fe574d2f96f793a39364ed4d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:30.495051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb726-ac3a-42d3-9d43-8a798fe2ab92 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:30.495553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb726-ac3a-42d3-9d43-8a798fe2ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:30.495623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb726-ac3a-42d3-9d43-8a798fe2ab92 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:30.496971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 49/98] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:30.503046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:30.503337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:30.503619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:30.526231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:30.527449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:30.529899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47ef9-9352-4b13-ba23-a02c0973a2e3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:30.530188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47ef9-9352-4b13-ba23-a02c0973a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:30.530471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47ef9-9352-4b13-ba23-a02c0973a2e3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:30.531833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 50/99] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:30.546804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:30.547098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:30.547361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:30.575668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:30.577093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:30.663624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 50/100] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:30.690093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:30.723235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 51/101] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:30.754494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:30.774067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:30.815666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12cbd3-072f-400f-b11d-780951cdd693 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:30.868509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:30.869539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:30.870078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:30.870553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:30.882004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:30.889460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:30.901028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:30.901940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:30.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 51/102] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:30.911237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:31.061779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc3a1-187b-49c2-aea2-180383f7a74d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:31.070303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb79b-dfc9-4eed-a131-ca4c48be3082 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:31.097306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:31.130623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:31.131267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:31.131553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:31.131836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:31.132565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:31.132872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:31.134294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:31.148721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 52/103] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:31.155374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:31.170642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:31.171314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:31.171594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:31.171868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:31.173033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:31.174622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:31.176376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 52/104] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:31.181825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:31.321059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5cb07-04fd-4059-bcda-16aea2b3660d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:31.376491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:31.377198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:31.377485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:31.377766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] PATH_INFO: `/v3/users/06f29f01d4f24748966ba83d1f0a48da` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:31.379324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:31.387743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8e72b-0cdf-4141-bbc7-83ee8ea88177 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:31.396901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=06f29f01d4f24748966ba83d1f0a48da)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:31.398516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:31.400388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 53/105] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:31 2022] GET /identity/v3/users/06f29f01d4f24748966ba83d1f0a48da => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:31.409954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:31.440531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:31.441197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:31.441475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:31.441749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:31.442436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:31.443868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:31.489918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:31.499250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 53/106] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:42:31 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:31.583183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fbcd5-a57c-4b59-a311-38c15d5d0cd3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:31.624713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:31.625381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:31.625661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:31.625937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:31.719233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:31.720753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:31.773544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:31.843275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:31.848655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.011146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c424c5-c029-4e39-9738-81e189b4bcca None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:32.064511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:32.065222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.065511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.065792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.069708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:32.071165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d24ddf-33ad-4119-8756-c44a264dece9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:32.073277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 54/108] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:31 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:32.079983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.158407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3b5c-a156-42fe-b44c-b03c50f5f583 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.158711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3b5c-a156-42fe-b44c-b03c50f5f583 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.159002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3b5c-a156-42fe-b44c-b03c50f5f583 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.160740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 55/109] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:32.165854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd093a3-1f4b-4fd3-93e5-2a2ec506ae5f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.166137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd093a3-1f4b-4fd3-93e5-2a2ec506ae5f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.166414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd093a3-1f4b-4fd3-93e5-2a2ec506ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.206866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9dd093a3-1f4b-4fd3-93e5-2a2ec506ae5f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:32.207954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9dd093a3-1f4b-4fd3-93e5-2a2ec506ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:32.231996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:32.243300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fa8-3970-43fc-b438-f9d8c78b0954 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:32.321701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:32.322339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.322625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.322905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.323700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=06f29f01d4f24748966ba83d1f0a48da) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:32.324030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:32.325503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:32.335324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:32.335609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 55/111] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:32 2022] GET /identity/v3/role_assignments?user.id=06f29f01d4f24748966ba83d1f0a48da&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:32.375971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.378961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:32.478171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d577-daab-4648-887d-31fa7a500cc9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.478774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d577-daab-4648-887d-31fa7a500cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.479273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d577-daab-4648-887d-31fa7a500cc9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.480875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 57/112] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:32.491597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4edd6-c1d1-4b25-b78c-3cf45e10b15f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.492222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4edd6-c1d1-4b25-b78c-3cf45e10b15f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.492693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4edd6-c1d1-4b25-b78c-3cf45e10b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.521817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38bd6-6930-4837-a97b-7754a7d64b9a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:32.526198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9ea4edd6-c1d1-4b25-b78c-3cf45e10b15f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:32.528067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9ea4edd6-c1d1-4b25-b78c-3cf45e10b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:32.586661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:32.587322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.587602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.587883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.616181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:32.621625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:32.622611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:32.630057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 56/113] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:32.633983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.651376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 58/114] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:32.656305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecb71-0e13-4df8-b708-858e76d18efa None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.656831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecb71-0e13-4df8-b708-858e76d18efa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.657369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecb71-0e13-4df8-b708-858e76d18efa None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.658890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 59/115] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:32.666157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.666894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.668811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.712928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:32.714156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:32.755219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:32.797352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a277f8-6594-44fd-af63-a6085d29d9f6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:32.827041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 60/116] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:32.827910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.841012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:32.877238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:32.877887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:32.878172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:32.878452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:32.879190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:32.879495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:32.880902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:32.903293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 57/117] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:32.904042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:32.954653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9ab6-db4d-4a83-b41e-742c371d0bca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.018502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.019078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.019361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.019639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.042526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:33.048118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:33.049258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 61/118] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:33.050213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.094611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821cdd-ed99-4c0d-87aa-4850dbf2d4fb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.125823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.141372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.142562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.142991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.143411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.143926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.158797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:33.166202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:33.167220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:33.168170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:33.170495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 58/119] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:33.172421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.184730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa28bb-57d6-488b-837c-7c2a125fc0a1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.222338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.223366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.223850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.224326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.225730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.227527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c2fe6-38ed-4dbe-bf58-fd6896b44c12 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.229730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 62/120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.231277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf908d-fed8-4cf1-8c7c-2ab42d6b1e44 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.231832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf908d-fed8-4cf1-8c7c-2ab42d6b1e44 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.232308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf908d-fed8-4cf1-8c7c-2ab42d6b1e44 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.233784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 63/121] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:33.234802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf908d-fed8-4cf1-8c7c-2ab42d6b1e44 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.282455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4320-33d8-42f6-b879-4666dd10bf5e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.316942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.317289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.317555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.317828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.318539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:33.318844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.320341 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.333055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 59/122] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.333908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.347517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf908d-fed8-4cf1-8c7c-2ab42d6b1e44 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.383315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.386774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.387741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.388802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.389346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.390465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:33.390969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.392722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09727766-85ba-404e-91fd-ff31dc735dc1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.398496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.403660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 64/123] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.406075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.406652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.407129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.425836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:33.427321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:33.441724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea62e2-3370-4647-9aec-b5d5eec61fd2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.478608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.479310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.479609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.479960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.481450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.483141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.485277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 60/124] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.486261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.507705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 65/125] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:33.508901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.616212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25eeed-fa5f-4954-ae01-fabd38176cd3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.619359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d1877-8ae9-4e68-9092-e417e28c1bd7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.631548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.654907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.655211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.656208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.656499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.656850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.658152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.659662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.661435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 61/126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.663090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.663965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.664464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.665014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.666409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.667340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.669736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.671728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 66/127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:33.672756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.783518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c88a-2697-4c55-905e-a74ebb258899 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.793147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0f164-0758-4c52-884b-7ec75467aeb8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.819027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.819699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.819983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.820304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/22a09630f2c6495ebffc46802a44f338/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.822470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, user_id=22a09630f2c6495ebffc46802a44f338, role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:33.824019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:33.831199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:33.832140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:33.832624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:33.833179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:33.840391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 62/128] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:33 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/22a09630f2c6495ebffc46802a44f338/roles/b145351ec6374b099e83fb311cea5308 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:33.842350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.850757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:33.860491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:33.861456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:33.862205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:33.864698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 67/129] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:33.865738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:33.898826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.939709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:33.970208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c181-bf09-46fb-8709-0d2b62ecb8d3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:33.985984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04e4d2-79d8-4bd4-8e29-84a4c8fbbb5b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.011410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.012348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.012771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.013776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.015167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.016793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.023794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 63/130] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:34.024963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.027410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.028264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.028614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.029055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.030553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.032000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.033888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 68/131] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:33 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:34.034748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.137260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bb11a-5b38-4974-8484-15f978311f37 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.142943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e5a1-c67f-4ea2-860f-c4b704503fd8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.149926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:34.172439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:34.178382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.179292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.179791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.180254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.181191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:34.181690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.182283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.182964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.183246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.183521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/ab9d252f59de4268acb7a07e5f3ccbd8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.184150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.186353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, user_id=ab9d252f59de4268acb7a07e5f3ccbd8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.187718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.195017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 64/132] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:34.200726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.206821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 69/133] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:34 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/ab9d252f59de4268acb7a07e5f3ccbd8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:34.207994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.339336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b225-c15b-4318-84e8-745a9163d9a6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.386831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.388575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.389056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.389762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.391825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.393942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.396374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 70/134] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:34 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:34.400795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84d5c-2ade-4c37-96de-da0c4ddf6f14 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.406283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.468784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.469507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.469788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.470066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/22a09630f2c6495ebffc46802a44f338/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.472032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, user_id=22a09630f2c6495ebffc46802a44f338, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.473526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.490377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 65/135] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:34 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/22a09630f2c6495ebffc46802a44f338/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:34.502272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:34.555923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5e1f-02a1-47f1-bee9-2025fc3a576e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.600073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.600798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.601119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.601455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] PATH_INFO: `/v3/projects/e1c3300c8ec741fab665c6f998ee91af` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.602782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c3300c8ec741fab665c6f998ee91af)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.604426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652dfdd-3e8a-459a-87d3-9871afc8a1c3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.606264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 71/136] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:34 2022] GET /identity/v3/projects/e1c3300c8ec741fab665c6f998ee91af => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:34.612427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:34.661370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:34.714321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be482c-6eb9-435b-8bff-65a194f661b3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.716703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be482c-6eb9-435b-8bff-65a194f661b3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.718002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be482c-6eb9-435b-8bff-65a194f661b3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.719609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 72/137] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:34.725128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e75-31cd-4daf-880d-b25c1e3e45fe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.725465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e75-31cd-4daf-880d-b25c1e3e45fe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.725759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e75-31cd-4daf-880d-b25c1e3e45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.750874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf0ed-64bb-4138-9720-f5fa4b664a13 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:34.758367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1c369e75-31cd-4daf-880d-b25c1e3e45fe None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:34.759599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c369e75-31cd-4daf-880d-b25c1e3e45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:34.816347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:34.817093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:34.817384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:34.817771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] PATH_INFO: `/v3/projects/e1c3300c8ec741fab665c6f998ee91af/users/22a09630f2c6495ebffc46802a44f338/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:34.819867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c3300c8ec741fab665c6f998ee91af, user_id=22a09630f2c6495ebffc46802a44f338, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:34.821346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:34.848086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 66/138] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:34 2022] PUT /identity/v3/projects/e1c3300c8ec741fab665c6f998ee91af/users/22a09630f2c6495ebffc46802a44f338/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:42:34.868374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 73/139] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:34.900906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.036179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:35.042773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8708a4-8c69-44fc-8cd7-622fcd592e57 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.043052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8708a4-8c69-44fc-8cd7-622fcd592e57 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.043317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8708a4-8c69-44fc-8cd7-622fcd592e57 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.045419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 74/140] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:35.051410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.051743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.052023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.056805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef772a0-4e6d-46bd-964f-8b04b42cea52 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.082147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:35.083597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:35.127967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.128638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.129071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.129363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.141853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:35.147507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:35.148354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:35.149175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 67/141] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:35.160154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.186141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:35.227789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 75/142] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:35.278385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.333474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f960b-ed8b-40b7-a17a-71c26a869e93 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.404327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.404961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.405271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.405550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.406284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:35.406591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.407984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:35.428742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 68/143] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:35.435717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.479941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:35.498326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e7dac-35f4-49cd-8a9a-159b6c596566 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.569393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.570051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.570330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.570600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.574412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.576080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:35.577948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 76/144] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:35.583733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.602236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3176-d391-4fdb-854c-e9a5ec907ab5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.639474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.640133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.640471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.640754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] PATH_INFO: `/v3/users/06f29f01d4f24748966ba83d1f0a48da` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.642128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] RBAC: Authorizing `identity:get_user(user_id=06f29f01d4f24748966ba83d1f0a48da)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.643664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:35.645442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 69/145] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:35 2022] GET /identity/v3/users/06f29f01d4f24748966ba83d1f0a48da => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:35.650846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.675992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:35.742170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:35.766722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4954a-fad8-4820-b92f-7d3dedc9d783 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.798924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3148a7-54f4-47e8-8bd7-d075cf2296c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.809776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.810426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.810769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.811047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.815843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.815843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:35.815843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 70/146] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:35 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:35.821412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:35.864067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.865113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.865586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.866046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.866931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.868561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c83d0f-2229-4081-bed0-6b0a14eb6ad9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:35.906365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 77/147] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:35 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:42:35.949068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62564c-6417-4366-9557-d11a386a2d0c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:35.986351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:35.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:35.987672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:35.987958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/06f29f01d4f24748966ba83d1f0a48da/roles/95d1f6f8b06245a7a1757b5ec15589d0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:35.991014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, user_id=06f29f01d4f24748966ba83d1f0a48da, role_id=95d1f6f8b06245a7a1757b5ec15589d0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:35.992097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f84e0-9fe5-414c-92b5-17ef944f56fa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:36.007311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 71/148] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:35 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/users/06f29f01d4f24748966ba83d1f0a48da/roles/95d1f6f8b06245a7a1757b5ec15589d0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:36.543160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db59-50b7-4a11-b069-b09381479d59 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:36.543449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db59-50b7-4a11-b069-b09381479d59 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:36.543713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6db59-50b7-4a11-b069-b09381479d59 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:36.545871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 78/149] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:36.562625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:36.563097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:36.563175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:36.588093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:36.589382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:36.593251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:36.675222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 72/150] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:36.710261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6db59-50b7-4a11-b069-b09381479d59 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:36.844115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6db59-50b7-4a11-b069-b09381479d59 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:36.851714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:36.883245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:36.883953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:36.884228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:36.884544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:36.901879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:36.907446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:36.908294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:36.909549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 79/151] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:36.918889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:37.047635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209f78-ed16-4808-94f9-a334acda00c1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:37.090677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:37.092347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.092633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.092909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.093671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:37.094030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:37.095497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:37.104498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 73/152] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:37.111068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:37.277218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853642-1ff4-40c9-bb32-9ff0843ea639 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:37.324172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:37.324828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.325138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.325498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.326827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:37.328295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:37.330421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 80/153] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:37 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:37.335987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:37.338930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:37.453329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0722293-b2cc-4137-b35d-8d67f0157ba2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:37.499233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:37.499871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.500151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.500426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.584437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:37.585944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d044df2-8c18-4007-947e-43cab7e06561 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:37.587846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:37.705356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 74/154] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:37.710878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:37.749351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:37.752098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c746e-2f0b-4356-bb99-27b5a3cb4d36 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.752403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c746e-2f0b-4356-bb99-27b5a3cb4d36 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.752638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c746e-2f0b-4356-bb99-27b5a3cb4d36 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.754170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 75/155] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:37.764853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89716fa-f335-4430-bf8b-c000a1af9509 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.765173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89716fa-f335-4430-bf8b-c000a1af9509 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.765449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89716fa-f335-4430-bf8b-c000a1af9509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.792850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d89716fa-f335-4430-bf8b-c000a1af9509 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:37.795997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d89716fa-f335-4430-bf8b-c000a1af9509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:37.880545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c27c-8857-499d-8ec4-2cf8da7c6a6a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:37.920052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 76/156] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:37.947691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b1204-2539-479f-9824-668e622de844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:37.947913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780328b0-4f23-48ac-a563-3532cb27005f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.948165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780328b0-4f23-48ac-a563-3532cb27005f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.948348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1204-2539-479f-9824-668e622de844 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.948451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780328b0-4f23-48ac-a563-3532cb27005f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.948630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1204-2539-479f-9824-668e622de844 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.948909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1204-2539-479f-9824-668e622de844 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.949882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 77/157] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:37.951208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1204-2539-479f-9824-668e622de844 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:37.952795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1204-2539-479f-9824-668e622de844 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:37.954663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 81/158] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:37 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:37.956920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780328b0-4f23-48ac-a563-3532cb27005f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:37.958778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:37.959124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:37.959442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:37.986853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:37.988115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:38.007722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:38.126761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780328b0-4f23-48ac-a563-3532cb27005f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:38.159352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 82/159] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:38.160195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:38.190802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:38.191471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.191754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.192028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.205151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:38.210493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:38.211433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:38.212860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 78/160] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:38.218258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:38.241996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:38.360533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:38.363734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39287ba9-c334-43bf-8b2a-ee0de97f4807 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:38.418117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:38.418748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.419606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.420037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.420769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:38.421098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:38.428049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:38.437070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 79/161] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:38.441978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:38.444337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250daac-35dd-4b70-acfe-908ee9373ecd None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:38.552499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:38.553075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.553361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.553636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.554427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:38.554733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:38.556185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235d89-b59b-489b-9f63-56699819fed4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:38.572882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 83/162] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=b145351ec6374b099e83fb311cea5308 => generated 608 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:38.574211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a68-ed42-4c1c-8506-19016946dedf None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.574500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a68-ed42-4c1c-8506-19016946dedf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.574775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a68-ed42-4c1c-8506-19016946dedf None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.576895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 84/163] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:38.581815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c6a68-ed42-4c1c-8506-19016946dedf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:38.611324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051b02-b9a4-4b4e-935e-cfd3f3f334ea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:38.701949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:38.702691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.702972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.703246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.725639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-051c7012-b1e0-46b1-951d-b53ead37724e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:38.731278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:38.732483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:38.733306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:38.735603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 80/164] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:38.736927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.737384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.737856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.765817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:38.767273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:38.790077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:38.853385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:38.862820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c6a68-ed42-4c1c-8506-19016946dedf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:38.912084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:38.912949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:38.923936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:38.924595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:38.924877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:38.925176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] PATH_INFO: `/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:38.926362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d252f59de4268acb7a07e5f3ccbd8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:38.927801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:38.929434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 85/166] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/users/ab9d252f59de4268acb7a07e5f3ccbd8 => generated 247 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:38.936653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.081703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0999bde-2ff8-4fe4-a2b1-33fba0b36f36 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.134309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.135287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.135792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.136260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.192033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48584-9ab9-4816-90c2-d352d8615db9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.199795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:39.238142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:39.239955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:39.324928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.326896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.327171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.327452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.328176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:39.328492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:39.329904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:39.365087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 82/167] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:39.365087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.381301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:39.426603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 86/168] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:42:39.427990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.479127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797862-23bd-4c89-af99-d5c3e4396d61 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.517267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.517914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.518193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.518466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.529501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:39.534436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:39.535302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:39.536112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 83/169] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:39.536757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.609505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:39.625374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:39.708886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee117-4a56-4b74-b656-b8063956615a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.713196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a327-9b4a-4358-a82c-84bd7475b571 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.785737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.786213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.786872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.787154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.787429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.787695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.788180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.788640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.789595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:39.790361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:39.791029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:39.792284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:39.792803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 87/170] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:39.794522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.795395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 84/171] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:39.803446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.916624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27ee0-55e5-42a5-91e2-11aec1b0ec69 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.934233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9357c90-e53a-4ff4-8ceb-baa5c2c15951 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:39.947497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:39.961393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.961962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.962257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.962492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.963209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:39.963508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:39.965024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:39.979091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 88/172] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:39.979954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:39.982134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:39.982837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:39.983122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:39.983393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:39.990228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.099908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9211-0539-455b-acca-5c42d7ea3d50 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:40.129817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:40.131650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f34f64-1f6f-4e07-9e34-7186e76326a4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:40.146235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:40.146872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.147152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.147426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.148216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=ab9d252f59de4268acb7a07e5f3ccbd8) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:40.148521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:40.149988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817d46-4911-415c-8702-d4066002df9b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:40.164128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 89/173] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/role_assignments?user.id=ab9d252f59de4268acb7a07e5f3ccbd8&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:40.166330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65716b74-d2a8-4836-9e02-5844c58964ae None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.166984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65716b74-d2a8-4836-9e02-5844c58964ae None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.168634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65716b74-d2a8-4836-9e02-5844c58964ae None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.173311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 90/174] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:40.174609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65716b74-d2a8-4836-9e02-5844c58964ae None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.296969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.323971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 85/175] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:40.331594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0e304-76de-4c27-b900-9fbe1ad46ac5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.334061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0e304-76de-4c27-b900-9fbe1ad46ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.334554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0e304-76de-4c27-b900-9fbe1ad46ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.364548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b0e0e304-76de-4c27-b900-9fbe1ad46ac5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:40.367194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b0e0e304-76de-4c27-b900-9fbe1ad46ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:40.390548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65716b74-d2a8-4836-9e02-5844c58964ae None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:40.423626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.451982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:40.452738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.453107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.453388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] PATH_INFO: `/v3/users/22a09630f2c6495ebffc46802a44f338` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.455832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] RBAC: Authorizing `identity:get_user(user_id=22a09630f2c6495ebffc46802a44f338)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:40.458254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:40.458875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 91/176] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/users/22a09630f2c6495ebffc46802a44f338 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:40.459656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.489392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 86/177] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:40.491539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f8fb-1aed-4821-bc41-ecc8d9e59375 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.492048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f8fb-1aed-4821-bc41-ecc8d9e59375 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.492666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f8fb-1aed-4821-bc41-ecc8d9e59375 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.494582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 87/178] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:40.496027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f8fb-1aed-4821-bc41-ecc8d9e59375 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.599666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2f7-203a-4cba-8faf-9c34ee76811c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:40.629558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f8fb-1aed-4821-bc41-ecc8d9e59375 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:40.633957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.652695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:40.654585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.654885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.655147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.657094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:40.658564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcafb62-874a-4489-8ca8-ffe7f75d96e3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:40.660254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 92/179] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:40.668061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.668336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.668633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.681205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:40.682238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.682730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.683293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.694057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:40.695958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:40.732995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.775171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:40.776655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:40.783851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 93/180] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:40.785826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.879636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 88/181] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:40.880411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.885785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892bb31-d703-4b0b-aea2-a5c22fb76756 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:40.909333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.921882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:40.922556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.922834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.923104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.933383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4de0fbee-9b1e-4af4-b888-6e4012eb72af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:40.938652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:40.939531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:40.940459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 94/182] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:40.941648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8261c-e60f-4821-a4fe-ce7507de3367 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.941648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8261c-e60f-4821-a4fe-ce7507de3367 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.941648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8261c-e60f-4821-a4fe-ce7507de3367 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.942894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 95/183] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:40.943904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bcd9-bfae-41b2-af80-580c81aa2c56 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:40.944183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bcd9-bfae-41b2-af80-580c81aa2c56 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:40.944455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bcd9-bfae-41b2-af80-580c81aa2c56 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:40.945869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 96/184] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:40.946480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bcd9-bfae-41b2-af80-580c81aa2c56 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:40.953809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:40.992657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c544e-b637-45e4-887d-2b9d18748556 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.026841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.027448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.027720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.027987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.029080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:41.029391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.030830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.036378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 89/185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=89195211fe574d2f96f793a39364ed4d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.037256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.052346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bcd9-bfae-41b2-af80-580c81aa2c56 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.091210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.092651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.093247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.093530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.110584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:41.117276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:41.118203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:41.119011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:41.119716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 97/186] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:41.120969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.162039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416f673-a974-4fc6-860b-b66dd112792d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.171233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.194028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.206485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.207150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.207430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.208148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] PATH_INFO: `/v3/projects/e1c3300c8ec741fab665c6f998ee91af` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.209458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] RBAC: Authorizing `identity:get_project(project_id=e1c3300c8ec741fab665c6f998ee91af)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.212726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbaffb-8d5c-4749-bcaa-c0b694e97e1a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.213575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 90/187] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/projects/e1c3300c8ec741fab665c6f998ee91af => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.214620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.215011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.215290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.240713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38cf82-5133-4fff-a40f-ceba0c5cc266 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.240897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:41.240897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:41.276088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.276711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.277036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.277371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.278594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:41.278891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.280462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53e19-9bbc-45ce-ba44-d1c190826f6b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.289139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 98/188] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.290404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.290800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.291081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.308169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:41.309924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:41.313041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 91/189] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:41.313879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.378243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 99/190] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:41.379071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.412973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.417481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2e43d-a0c8-4f0e-93de-8892d797c22b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.443174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.452483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.453132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.453413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.453687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.454401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:41.454705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.456077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.464071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 92/191] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.464846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.480087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3951f6-eef1-401a-8d8c-abc7fa2c409e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.514331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.514944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.515222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.515494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.516274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=e1c3300c8ec741fab665c6f998ee91af, user.id=22a09630f2c6495ebffc46802a44f338) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:41.516609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.518164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.523745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 100/192] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/role_assignments?user.id=22a09630f2c6495ebffc46802a44f338&scope.project.id=e1c3300c8ec741fab665c6f998ee91af&role.id=89195211fe574d2f96f793a39364ed4d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.524503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.571176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e008d-c625-41c5-b1bf-b7b79e184282 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.613139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.613931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.614061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.614338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] PATH_INFO: `/v3/users/06f29f01d4f24748966ba83d1f0a48da` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.615555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] RBAC: Authorizing `identity:get_user(user_id=06f29f01d4f24748966ba83d1f0a48da)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.617054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.619028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 93/193] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/users/06f29f01d4f24748966ba83d1f0a48da => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.619831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.642148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.645907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028c9d-9652-4337-8ba0-7779d8f32e56 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.688930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.690592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.691222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.691468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.691745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.692938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.694502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.696613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 101/194] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.698285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.745072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c7a3-3922-4c6f-a3f8-6473693d70cf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.781065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.781715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.781991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.782263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.792825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:41.798832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:41.799754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:41.800538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 94/195] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:41.805790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.807214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dbd91-2e61-4cef-a1fb-aa39b50c4e39 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.839689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.840330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.840641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.840907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.854156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.855604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:41.857926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 102/196] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:41.858643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:41.887076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.905009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7feb04-4317-41a6-ada3-9cdc28b4b656 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.921365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:41.939174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.939712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.939992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.940263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.956803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a93bf-72e4-4c81-adba-4a9c1bd8c215 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:41.989627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:41.990234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:41.990512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:41.990785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:41.991453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:41.992880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.008693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.010295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.016327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 103/197] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:41 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:42.017954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.124421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.126537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 95/198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:42.127397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.146902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.148053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90764e4-6746-4e8b-ae20-965350f8b2be None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.191427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.191982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.193063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.193063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.193436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:42.193743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.195912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.206418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 104/199] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:42.207151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.247388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9ad3-a5c7-46e4-8fe7-62dfa1542dbc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.291319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.291949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.292225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.292500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.325236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97342b-faf4-4e01-89cc-eeef45a4caf4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.368440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.369131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.369407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.369685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.370862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.372648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.374392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 105/200] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:42.375161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.379051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.380606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.396201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.403794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.486816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a2ff-5395-40f9-b1c0-b93988078fd1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.496617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 96/201] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:42.498183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.522997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.523664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.523966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.524214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.525444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.526982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.528902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 106/202] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:42.529800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.610078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a507-5179-485f-9e6f-9a145e2424a0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.614598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.630718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.636571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb82e3-1f36-4960-b888-a635fa711871 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.650785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.651740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.652293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.652755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.654436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, scope.project.id=1fe8de6a1053497ab83417b274c6ca85, user.id=06f29f01d4f24748966ba83d1f0a48da) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:42.654960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.656692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.663805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 97/203] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/role_assignments?user.id=06f29f01d4f24748966ba83d1f0a48da&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:42.664852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.691232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.691917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.692204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.692482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.695373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.697052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.699495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 107/204] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:42.705612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:42.790679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc086-0dc2-42f4-9f56-6e1e62acc5ec None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.832348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.833493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.834044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.834512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.890669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6013f-0690-455f-9093-463c768a8e64 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:42.892237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:42.917814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.921207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.931316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:42.931958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:42.932243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:42.932520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:42.933344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=f5238ecf64c54578bb5363bafb001c91) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:42.933654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:42.935777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:42.942608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 108/205] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/role_assignments?user.id=f5238ecf64c54578bb5363bafb001c91&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:43.046274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 98/206] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:43.051791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:43.070344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:43.175009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a2112-7807-47c5-a7fa-1c98d11d7a8d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:43.214444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:43.215087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:43.215364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:43.215716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:43.217532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:43.219007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c8cd0-afc5-44d1-ab64-7e86002501a4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:43.220963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 109/207] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:43 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:43.226871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:43.314339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:43.339252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d370bbd-77eb-4f3c-972a-32194a59c6e4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:43.386420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:43.387107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:43.387971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:43.388250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:43.389079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=f5238ecf64c54578bb5363bafb001c91) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:43.389390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:43.390877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4183f9c-f3b8-4687-88a1-333f6d35f7b7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:43.399242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 99/208] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:43 2022] GET /identity/v3/role_assignments?user.id=f5238ecf64c54578bb5363bafb001c91&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=b145351ec6374b099e83fb311cea5308 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:44.319988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef98d-00a0-49a7-ac66-16b485154602 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.320503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef98d-00a0-49a7-ac66-16b485154602 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.320578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef98d-00a0-49a7-ac66-16b485154602 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.322095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 110/209] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:44.327882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.328683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.329195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.351600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:44.352797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:44.414970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d908d3-34d9-4ef5-89c5-0aba47c5d365 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.415585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d908d3-34d9-4ef5-89c5-0aba47c5d365 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.416088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d908d3-34d9-4ef5-89c5-0aba47c5d365 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.417674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 111/210] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:44.423442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.423980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.424460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.424632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 100/211] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:44.443114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:44.444623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:44.451761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:44.533002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 112/212] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:44.542333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:44.550253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:44.563144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:44.570423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85269db-0161-4a04-bebc-711714b66d61 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:44.607862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:44.608512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.608791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.609114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.610270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:44.611775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:44.613577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 101/213] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:44.618823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:44.662523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c3c6f-ccba-4b7c-9898-faa4de765250 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:44.711707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:44.712644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.713159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.713632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.724777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:44.726863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66bad-4c88-4dbf-985c-8ead27da956e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:44.730062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:44.731480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:44.732286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:44.734662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 113/214] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:44.740673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:44.771051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:44.772063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.772544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.773066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.773944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:44.775602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:44.801346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:44.808918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 102/215] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:44 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:42:44.826802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:44.868131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e109a1f-d3b7-4ec8-8ee7-04720fe8e7e4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:44.907851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:44.908597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:44.908880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:44.909223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:44.909960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:44.910250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:44.911649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:44.922186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 114/216] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:44.928077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.041805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56377f54-f561-4c66-ad61-89dc2643afc3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.079120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.079698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.079971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.080240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] PATH_INFO: `/v3/users/398718f38b844218a01eafe63fa35434` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.095542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=398718f38b844218a01eafe63fa35434)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.097030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e7b7-b316-4e93-a810-0899b8852fb9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.099046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 103/217] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:44 2022] GET /identity/v3/users/398718f38b844218a01eafe63fa35434 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:45.104652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.137260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33299-ee89-4852-8013-ca08c949ea53 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.137611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33299-ee89-4852-8013-ca08c949ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.137865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33299-ee89-4852-8013-ca08c949ea53 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.139198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 104/218] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:45.144602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.144886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.145191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.166694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:45.166694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:45.232835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.239753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191d4c-7ae5-4579-8d60-a05484a09d64 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.260412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 105/219] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:45.274924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.281806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.282743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.282848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.283058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.284123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.357798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664047f-44d9-4607-9a1e-920121f4f17a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.393702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaa137-13ca-4fde-95a0-b6116d45f17c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.437007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.437897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.439078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.439494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.454710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4334bcf9-ac3a-4b57-80e8-375d5a814f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:45.460408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:45.461327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:45.462117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:45.465210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 106/220] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:45.471996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7987-e689-43c8-9717-69e90b4e474e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.472281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7987-e689-43c8-9717-69e90b4e474e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.472554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7987-e689-43c8-9717-69e90b4e474e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.474053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 107/221] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:45.476013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7987-e689-43c8-9717-69e90b4e474e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.522010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 115/222] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:42:45.523604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.523890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.524161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.531354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.546406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:45.547928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:45.585364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.593923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7987-e689-43c8-9717-69e90b4e474e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.629955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.630925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.631395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.631906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.632508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 116/223] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:45.637654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.638409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:45.638959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.640781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.659037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 108/224] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:45.665318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.755254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ebea5-792c-4b1e-b6e4-4b1f01f14d0a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.776636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251347c5-aacf-4c9b-9a70-0d8ec8900b87 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.786580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.792471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.793569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.793569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.794016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.795418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.796967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.798926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 117/225] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:45.799508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.815774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.816742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.817271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.817738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.819131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.820831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.827683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 109/226] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:45.828877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.832362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:45.913401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ded94-5a03-4707-bbfd-f3ed10d5dc5b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.933200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c06a8a-cdc5-4a8e-94ed-ee7b7fe1d466 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:45.951525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.952186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.952466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.952739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.963933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:45.970034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:45.970447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:45.971322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:45.972106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 118/227] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:45.972753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:45.978574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:45.979079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:45.979543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:45.980551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=398718f38b844218a01eafe63fa35434) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:45.981295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:45.982951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:45.988972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 110/228] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/role_assignments?user.id=398718f38b844218a01eafe63fa35434&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=89195211fe574d2f96f793a39364ed4d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:45.989979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:46.036552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:46.085536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:46.097793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f89b67-d168-46e2-b18f-c18c9aae0c3b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.128853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47b882-7285-4eb4-a0d9-0adcd98e9453 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.136684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.138037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.138676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.139155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.140658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.142398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.144492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 119/229] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:46.155143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:46.180307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.180823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.181135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.181405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.182114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:46.182414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.183786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.192825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 111/230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:46.198761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:46.273985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68104-6dd9-4545-a82c-bde9cede9aa2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.302552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff183-c4a7-4413-9b8c-6966fd6124d8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.304221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:46.312401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.313124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.313513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.313800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/f5238ecf64c54578bb5363bafb001c91/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.315943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, user_id=f5238ecf64c54578bb5363bafb001c91, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.317435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.332900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:46 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/f5238ecf64c54578bb5363bafb001c91/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:46.362543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b169d-6511-4375-8df5-441e28756109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.363220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b169d-6511-4375-8df5-441e28756109 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.363494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b169d-6511-4375-8df5-441e28756109 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.363767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b169d-6511-4375-8df5-441e28756109 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.369946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b169d-6511-4375-8df5-441e28756109 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.371485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b169d-6511-4375-8df5-441e28756109 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.373872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 112/232] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:46 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:46.379382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:46.411883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:46.509796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47169f-9d92-4d2e-b477-de1b8bc1905b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.550134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.550793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.551075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.551347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.552527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.554011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2edf4-d020-4cc1-8587-7f2b9c754933 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.555701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 121/233] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:46 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:46.562240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b169d-6511-4375-8df5-441e28756109 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:46.669784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b169d-6511-4375-8df5-441e28756109 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:46.725015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:46.725691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:46.725974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:46.726255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/f5238ecf64c54578bb5363bafb001c91/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:46.728466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, user_id=f5238ecf64c54578bb5363bafb001c91, role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:46.730009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6a834-e461-424e-b963-86d29942dcf1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:46.752500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 113/234] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:46 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/f5238ecf64c54578bb5363bafb001c91/roles/b145351ec6374b099e83fb311cea5308 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:47.518514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7359a9-ced1-45a7-b0d8-e102589fb28b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:47.519048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7359a9-ced1-45a7-b0d8-e102589fb28b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:47.519120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7359a9-ced1-45a7-b0d8-e102589fb28b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:47.520617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 122/235] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:47.525933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:47.526224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:47.526503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:47.550820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:47.552056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:47.584442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:47.631618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8fb44-5231-41a5-9749-ac27a732a93c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:47.631938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8fb44-5231-41a5-9749-ac27a732a93c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:47.632172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8fb44-5231-41a5-9749-ac27a732a93c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:47.633692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 123/236] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:47.638791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:47.639071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:47.639345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:47.662665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:47.663861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:47.670358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 114/237] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:47.692401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:47.801361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 124/238] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:47.840377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:47.862254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:47.875221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d14d0-ffff-442f-b8e9-a77a5bdbae49 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:47.935801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:47.936444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:47.936728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:47.937017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:47.961826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:47.967149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:47.968022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:47.968817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 115/239] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:47.976007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:48.011001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260130a-9a6a-4285-afe9-a7299ea2810b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:48.017350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:48.153715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:48.154549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.154655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.159830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.159938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acc6b-25c9-419f-8778-d1360b8a28a7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:48.161704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:48.163154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:48.165000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 125/240] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:48.170269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:48.208169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:48.208953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.209258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.209528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.210243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:48.210543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:48.212080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:48.222308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 116/241] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:48.235980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:48.391236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:48.420353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4192-1156-4113-9f4e-859958c3e454 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:48.426020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:48.490605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a711-adc2-4b00-8303-2832adbe6f9a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:48.500806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:48.503094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.503652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.503924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.504613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:48.506078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:48.553721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 126/242] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:48 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:48.589819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:48.591415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.591958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.592233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] PATH_INFO: `/v3/users/7ed33baacb654f92b7729587343fd923` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.623320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] RBAC: Authorizing `identity:get_user(user_id=7ed33baacb654f92b7729587343fd923)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:48.624846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbf71a-5167-4bc6-a505-2d42ea1e2c2a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:48.628550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 117/243] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:48 2022] GET /identity/v3/users/7ed33baacb654f92b7729587343fd923 => generated 297 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:48.635826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:48.693778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3032-b8e5-47c0-8bab-5d86590d4ddf None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.694066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3032-b8e5-47c0-8bab-5d86590d4ddf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.694251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3032-b8e5-47c0-8bab-5d86590d4ddf None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.695756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 118/244] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:48.710951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035559e6-880e-4462-a265-5182ead48fed None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.711235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035559e6-880e-4462-a265-5182ead48fed None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.711503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035559e6-880e-4462-a265-5182ead48fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.753989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-035559e6-880e-4462-a265-5182ead48fed None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:48.759698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-035559e6-880e-4462-a265-5182ead48fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:48.862127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045431ab-114b-45b4-a49e-a48fc771f703 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:48.883232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 119/245] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:48.885744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48237-804a-46d2-9d09-7850e80885a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.886258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48237-804a-46d2-9d09-7850e80885a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.886535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48237-804a-46d2-9d09-7850e80885a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.888232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 120/246] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:48.893682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.893995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.894273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.910074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:48.910717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:48.911003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:48.911278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:48.917547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:48.919522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:48.922595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.000242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.002202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.002356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.008678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 121/247] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:49.009342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.130605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 127/248] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:49.131451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.134662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b140-5aa4-415c-8f74-d826dcaf77e6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.175157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.175812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.176091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.176368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.182629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.205649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:49.210703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:49.211594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:49.212392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 122/249] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:49.213092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.251428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cd35-2376-47a9-bb18-04903bfc4e8c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.291689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.292359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.292658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.293005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.315348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:49.320340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:49.321248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:49.322060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 128/250] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:49.323511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.387382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.446862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.450579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84545-2bd0-4747-b8bf-67dccf95ff09 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.458446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63e26e-f741-48b7-b7c5-efe4919b3929 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.491773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.492475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.492754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.493087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.493858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:49.494167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.495621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.507362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 129/251] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:49.512152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.515064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.515954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.516406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.516871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.518259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.520351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dde785-9a62-453b-885f-ad4fa59cc0af None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.523082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 123/252] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:49.524721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddc0a-4173-4424-b018-4681909be2ec None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.525222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddc0a-4173-4424-b018-4681909be2ec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.525829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddc0a-4173-4424-b018-4681909be2ec None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.528721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 124/253] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:49.529956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ddc0a-4173-4424-b018-4681909be2ec None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.627259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd7a4-4029-4141-83be-060ef95db6b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.665986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ddc0a-4173-4424-b018-4681909be2ec None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.673835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.674590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.674971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.675340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.676166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:49.676567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.678087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.687142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 130/254] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:49.688147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.703034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.714750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.715936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.716208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.716535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] PATH_INFO: `/v3/users/398718f38b844218a01eafe63fa35434` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.718626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:49.719370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] RBAC: Authorizing `identity:get_user(user_id=398718f38b844218a01eafe63fa35434)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.721617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c439b6f-38fd-449f-8be8-9e6d15a9227a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.724710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 125/255] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/users/398718f38b844218a01eafe63fa35434 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:49.729936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.730223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.730498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.749339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:49.750394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:49.822657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 126/256] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:49.823529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.829164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10552205-86f5-49af-82f8-992ea6d135ed None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.867703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:49.868336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:49.868622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:49.868878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:49.869768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=7ed33baacb654f92b7729587343fd923) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:49.870667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:49.872372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:49.878617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 131/257] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/role_assignments?user.id=7ed33baacb654f92b7729587343fd923&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:49.879471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:49.966060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52d9d2-13e9-4f7d-9d68-4efb6fb231c8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:49.980356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.002115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.003327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6962b9-c8d6-4c5c-b8e1-1240c0a2511f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.015662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.017506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.018028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.018495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.019983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.021844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.024392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 127/258] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:50.025444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.064621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.065174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.065458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.065783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.067011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.068483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.070532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 132/259] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:49 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:50.071331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.204102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110338-4a67-4935-9335-4221c3426660 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.231385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a60a-2a84-4858-8b41-7da09e7eb165 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.268237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.269237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.269752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.270556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.333377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.348941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.350806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.354124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.354388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.354619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.354895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.413614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:50.418728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:50.419671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:50.420467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 128/260] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:50.425462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.464254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 133/261] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:50.466132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.533477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.575579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc8a8-2ef6-41cd-a63f-4e8a8f266225 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.609188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.613584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.614445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.614941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.615407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.616309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:50.616913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.619593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.628324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 134/262] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:50.629882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.694002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779a53-add2-413f-bb42-94690ba606a7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.737508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbd75-2e43-4f87-a44a-a47c40111db3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.747440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.748055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.748320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.748581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/398718f38b844218a01eafe63fa35434/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.750551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, user_id=398718f38b844218a01eafe63fa35434, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.752001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.769642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 129/263] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:50 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/398718f38b844218a01eafe63fa35434/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:50.770660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.780511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.781711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.782227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.782694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.784146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.789336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.790268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.792957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 135/264] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:50.799333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.906837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940316dd-be24-422e-9971-d25c25578a22 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:50.924305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:50.951979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:50.953021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:50.953523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:50.954184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] PATH_INFO: `/v3/users/f5238ecf64c54578bb5363bafb001c91` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:50.955658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] RBAC: Authorizing `identity:get_user(user_id=f5238ecf64c54578bb5363bafb001c91)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:50.957440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:50.959691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 130/265] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/users/f5238ecf64c54578bb5363bafb001c91 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:50.972439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:50.997068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f5251-ed34-4429-85c2-6c38b0568926 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:51.031583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:51.032217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.032503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.032782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.036876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=f5238ecf64c54578bb5363bafb001c91) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:51.036876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:51.036876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79b829-cca7-40d0-ad0d-1977ef5705ef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:51.046799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 136/266] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/role_assignments?user.id=f5238ecf64c54578bb5363bafb001c91&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:51.135248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fd5f-53a1-47ad-9c00-8ba29a8f9b59 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:51.182462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:51.183101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.183383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.184183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.249242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:51.272188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:51.273870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:51.409373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334bb25-b97d-40a3-97ee-1a10026ac1a4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.409718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334bb25-b97d-40a3-97ee-1a10026ac1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.409926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334bb25-b97d-40a3-97ee-1a10026ac1a4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.410773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 131/267] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:42:51.415314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 137/268] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:51.416214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:51.423084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.423379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.423665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.450331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:51.451643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:51.518499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:51.529366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:51.554387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eb44d-4b4f-443a-8eed-2736f8a0dbfd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:51.583470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 138/269] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:51.593684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:51.594391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.594675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.594948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.596114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:51.597625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:51.599425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 132/270] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:51 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:51.605136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:51.624458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:51.743764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e00c4-a5d4-4c1a-aa55-390e91097bd1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:51.773582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca100b9-c445-421a-ab6e-3f7c4112d6bc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:51.783219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:51.784132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.784603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.785099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.786072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=f5238ecf64c54578bb5363bafb001c91) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:51.786591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:51.788220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb03b-c0d8-4b71-921e-ded9e21d8639 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:51.794984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 139/271] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:51 2022] GET /identity/v3/role_assignments?user.id=f5238ecf64c54578bb5363bafb001c91&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=b145351ec6374b099e83fb311cea5308 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:51.796382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc535d-ddee-4d78-bc4c-3da7bf3d5fcc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.796909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc535d-ddee-4d78-bc4c-3da7bf3d5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.797413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc535d-ddee-4d78-bc4c-3da7bf3d5fcc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.798864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 140/272] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:51.808164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.809451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.810029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.829539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:51.831202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:51.845800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:51.846469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:51.846751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:51.847025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:51.863319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:51.868351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:51.869261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:51.870045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:51.878994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 133/273] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:51.893709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:51.903152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:51.920889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:51.960788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 141/274] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:52.009080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.052901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513db1-d0f8-4b83-9705-8c145568d1c1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.093726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.094724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.095208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.095683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.096610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:52.097137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.098801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.109084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 134/275] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:52.114178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.126862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa0d5-66b5-4d86-8337-70e858613be5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.166718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.167400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.167682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.167973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.170077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.171571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.177012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 142/276] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:52.179317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.216116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:52.236449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:52.259732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab1fcb-cb7c-48f1-ab04-7525998e6691 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.304014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.304585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.304869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.305178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] PATH_INFO: `/v3/users/c366a85a053f4278a9174bf21196be32` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.316942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a5aa-0fd7-4bc5-8df4-2cc22019e14a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.328223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] RBAC: Authorizing `identity:get_user(user_id=c366a85a053f4278a9174bf21196be32)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.329952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.335039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 135/277] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/users/c366a85a053f4278a9174bf21196be32 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:52.344218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.361673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.362331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.362619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.362900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.363761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.365308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e9df0-d43d-4398-98bd-966b958ed012 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.392776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 143/278] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:42:52 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:42:52.394411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0db29-19ac-4864-8b48-0e5332b0ad46 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.394737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0db29-19ac-4864-8b48-0e5332b0ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.395015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0db29-19ac-4864-8b48-0e5332b0ad46 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.396292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 144/279] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:52.402178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.402538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.402950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.422665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:52.424037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:52.490217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d052d-6c33-45fd-84a3-ce7780ff2d3d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.504758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 145/280] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:52.528659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.529497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:52.543779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.544932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.545412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.546083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.547608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, user.id=c366a85a053f4278a9174bf21196be32, scope.system=all) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:52.548164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.550373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.558179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 136/281] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/role_assignments?user.id=c366a85a053f4278a9174bf21196be32&scope.system=all&role.id=89195211fe574d2f96f793a39364ed4d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:52.569826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:52.690694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d6aa5-8dfe-418b-b925-824a93a73248 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.735566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.736227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.736523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.736774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.748726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:52.754887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:52.756475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:52.758010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 146/282] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:52.763151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:52.896634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a10211-9e50-40e0-ad92-8215311e2e67 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:52.940550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:52.941223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:52.941497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:52.941769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:52.942483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:52.942782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:52.944183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:52.955466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 137/283] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:52.960966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:53.081392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:53.104808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08c80-52cb-40e0-81ec-3399619ec1b5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:53.146762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:53.147379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.147656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.147923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] PATH_INFO: `/v3/users/7ed33baacb654f92b7729587343fd923` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.153755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] RBAC: Authorizing `identity:get_user(user_id=7ed33baacb654f92b7729587343fd923)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:53.155306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:53.157070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 147/284] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:52 2022] GET /identity/v3/users/7ed33baacb654f92b7729587343fd923 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:53.162708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:53.264360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:53.336824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6658f1-9857-4bac-bf71-2defb4282498 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:53.395829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:53.396491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.396828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.397079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.398279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:53.399739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d8c1-673d-463b-b042-4d64073eb318 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:53.401806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 138/285] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:53 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:53.407468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:53.547690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d090-6d5b-4a24-9e3b-31829f872680 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:53.587287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b965f-fa98-419a-b7fb-1fd96239bb18 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.587795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b965f-fa98-419a-b7fb-1fd96239bb18 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.588054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:53.588278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b965f-fa98-419a-b7fb-1fd96239bb18 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.589172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.589666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.590716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/7ed33baacb654f92b7729587343fd923/roles/95d1f6f8b06245a7a1757b5ec15589d0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.593224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, user_id=7ed33baacb654f92b7729587343fd923, role_id=95d1f6f8b06245a7a1757b5ec15589d0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:53.595203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:53.597797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 139/286] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:53.606168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.606833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.607337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.617763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 148/287] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:42:53 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/users/7ed33baacb654f92b7729587343fd923/roles/95d1f6f8b06245a7a1757b5ec15589d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:53.634117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:53.635681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:53.723906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 140/288] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:53.771912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:53.796221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:53.909257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac2d9-8317-4ce4-a7e4-68b11e79cf4a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:53.968078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:53.968755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:53.969214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:53.969387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:53.992018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:53.997876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:53.998843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:53.999647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 149/289] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:54.005882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:54.073410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:54.124969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3797-d0ce-42b5-bd8d-0895e7dad379 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:54.168577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:54.169622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:54.170109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:54.170582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:54.171494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:54.171998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:54.173625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:54.186059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 141/290] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:54.189422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:54.288300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:54.323468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8af9-16a8-43c8-9cc2-8bce4e120503 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:54.365588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:54.366231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:54.366509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:54.366784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] PATH_INFO: `/v3/users/398718f38b844218a01eafe63fa35434` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:54.373737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] RBAC: Authorizing `identity:get_user(user_id=398718f38b844218a01eafe63fa35434)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:54.375192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:54.377158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 150/291] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:54 2022] GET /identity/v3/users/398718f38b844218a01eafe63fa35434 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:54.382787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:54.555456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6491f0-6102-4b51-bff6-7fac3897fca6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:54.579801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:54.606697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:54.607335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:54.607619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:54.607898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:54.713960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:54.716050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb3d95-e04e-46c8-8313-9baf586cdf15 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:54.846457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 142/292] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:54.852176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:54.999014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c411-f990-4c56-8425-4eae7801a57e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:54.999383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c411-f990-4c56-8425-4eae7801a57e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:54.999590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c411-f990-4c56-8425-4eae7801a57e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.001214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 143/293] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:55.003503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ad7e-b30f-429f-8191-3e2d3f5ef938 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.018398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.018892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.018965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.046314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.047319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.047802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.048275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.050474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:55.051304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:55.052936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:55.054346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:55.056910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 151/294] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:54 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:55.086362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.093387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.109466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.198768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ae42f-98b5-4f17-8cc7-525404dbb62e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.223101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 144/295] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:55.236114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.237157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.237643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.238116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.239101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=398718f38b844218a01eafe63fa35434) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:55.239627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:55.241300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a37943-e5c1-4e1d-a924-3a04fd719a20 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:55.245611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.248127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 152/296] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/role_assignments?user.id=398718f38b844218a01eafe63fa35434&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=89195211fe574d2f96f793a39364ed4d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:55.274670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c480-afdf-47a1-854a-601200c121e4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.275049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c480-afdf-47a1-854a-601200c121e4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.275400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c480-afdf-47a1-854a-601200c121e4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.281097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 153/297] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:55.282781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4060-bec5-4707-a5a4-f511bbf27725 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.283139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4060-bec5-4707-a5a4-f511bbf27725 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.283518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4060-bec5-4707-a5a4-f511bbf27725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.322735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e92f4060-bec5-4707-a5a4-f511bbf27725 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:55.323955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e92f4060-bec5-4707-a5a4-f511bbf27725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:55.395231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3c99-1abe-4ca1-9c3d-857f6c0d9645 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.411091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 154/298] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:55.412363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6329-2ab8-47cf-a4bf-4c82774a8328 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.412652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6329-2ab8-47cf-a4bf-4c82774a8328 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.412921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde6329-2ab8-47cf-a4bf-4c82774a8328 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.422637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 155/299] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:55.428632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.428632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.428838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.440637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.441604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.442100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.442543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.444077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.452300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:55.453513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:55.462226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:55.468149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:55.469065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:55.469849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 145/300] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:55.470535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.488701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.540636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 156/301] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:55.541746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.611556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a703c9-4116-47d8-8232-40ab896da94b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.647660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.648219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.648493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.648759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.649924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:55.651351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:55.653859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 146/302] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:55.654415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.656102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397cdd-9aa4-4e70-b8e9-1a491e15fde4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.705099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.705739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.706011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.706276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.706995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:55.707292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:55.708653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:55.711362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.723738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 157/303] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:55.724469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.743789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:55.771501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530214-97cd-46c6-99e5-a96f7b175652 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.808313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.809538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.809812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.810100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.821292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:55.827576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:55.828512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:55.835057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 147/304] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:42:55.835883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f663-efd1-4d8d-9633-f069364caa67 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:55.835964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.871140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:55.874638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:55.874638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:55.874638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] PATH_INFO: `/v3/groups` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:55.874638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:55.874946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:55.897065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 158/305] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Aug 4 06:42:55 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:42:55.898101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:55.976211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af1f50-5488-4388-b40a-de2540423e8b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.002657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.023387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.024857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.025382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.025805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] PATH_INFO: `/v3/users/c366a85a053f4278a9174bf21196be32` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.027916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] RBAC: Authorizing `identity:get_user(user_id=c366a85a053f4278a9174bf21196be32)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.029766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.036910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 148/306] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/users/c366a85a053f4278a9174bf21196be32 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:56.038335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.042040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.069971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83947dcb-68dc-4a49-9691-ac9400d2b13e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.113244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.113888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.114314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.114600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.115319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:56.115686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.116999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.129184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 159/307] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:56.135181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.185083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b26a5-6dc2-43fb-9d05-2d7cb1de379f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.225749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.226591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.226972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.227352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] PATH_INFO: `/v3/system/users/c366a85a053f4278a9174bf21196be32/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.229253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c366a85a053f4278a9174bf21196be32, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.230756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5a239-af42-4792-8cff-61f21d23e18f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.243847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 149/308] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Aug 4 06:42:56 2022] PUT /identity/v3/system/users/c366a85a053f4278a9174bf21196be32/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:42:56.284266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb4f-e626-42b6-ac28-3977c569e3ba None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.309426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.326151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.327108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.327534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.327950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] PATH_INFO: `/v3/users/3d4f7cf2a7ef4055a28428742066f753` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.343536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f981-74a4-42d1-bc21-31d04ae6c301 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.343770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f981-74a4-42d1-bc21-31d04ae6c301 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.343986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f981-74a4-42d1-bc21-31d04ae6c301 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.345583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4f7cf2a7ef4055a28428742066f753)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.345851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 150/309] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:56.347491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.349826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 160/310] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:56 2022] GET /identity/v3/users/3d4f7cf2a7ef4055a28428742066f753 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:56.351188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.351468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.351747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.355957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.377062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:56.378832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:56.455344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.466101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 151/311] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:56.476523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac46-0bd0-4a41-907f-3661b8991952 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.491759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.516799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.517489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.517767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.518035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.519372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, user.id=3d4f7cf2a7ef4055a28428742066f753, scope.system=all) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:56.519677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.521747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.530461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 161/312] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 06:42:56 2022] GET /identity/v3/role_assignments?user.id=3d4f7cf2a7ef4055a28428742066f753&scope.system=all&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:56.620771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491999-10df-4659-b895-cd7d08d04006 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.658599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.659264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.659542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.659811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.672856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:56.679969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:56.680921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:42:56.681780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 152/313] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:56.690162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.739625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.798203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7adb-487c-47eb-90a1-92dbf9a990c9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:56.833458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:56.834078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:56.834353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:56.834623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:56.835327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:56.835660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:56.840071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:56.852184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 162/314] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:56.862198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:56.925712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:56.971593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c9e0d-f574-4078-b907-0b1805eef160 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:57.006188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:57.006746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:57.007022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:57.007294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] PATH_INFO: `/v3/users/7ed33baacb654f92b7729587343fd923` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:57.008529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] RBAC: Authorizing `identity:get_user(user_id=7ed33baacb654f92b7729587343fd923)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:57.010088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:57.011963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 153/315] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:56 2022] GET /identity/v3/users/7ed33baacb654f92b7729587343fd923 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:57.017343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:57.126013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d0f8-cc41-493e-90bb-b20bf8a05bc8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:57.129337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:57.162753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:57.163421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:57.163747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:57.164023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:57.237811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:57.239259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:57.347037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 163/316] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:42:57.352942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:57.462127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03d27-bc78-441a-ab44-e860bfca2489 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:57.487328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:57.498903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:57.499552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:57.499826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:57.500094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:57.501279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:57.502941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d900ac-176c-4d91-850e-1affdd278503 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:57.504895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 154/317] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:42:57 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:57.510721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:57.514570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:57.615588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d3a7-9244-4e19-89c4-87e1eb21ecb7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:57.650699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:57.651590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:57.652140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:57.652753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:57.653743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, scope.project.id=bd9905bef5f44abe8b6c660ba483de07, user.id=7ed33baacb654f92b7729587343fd923) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:57.654056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:57.655478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79b9f2-6f05-4497-92fc-fd17df51d5c1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:57.661753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 164/318] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:42:57 2022] GET /identity/v3/role_assignments?user.id=7ed33baacb654f92b7729587343fd923&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:58.117470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9edb-5bf7-49b2-98ab-fb82708e0574 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.117874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9edb-5bf7-49b2-98ab-fb82708e0574 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.118058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9edb-5bf7-49b2-98ab-fb82708e0574 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.119492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 155/319] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:42:58.124491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574894-12fe-41da-84e6-c72cb6d6769b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.124930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574894-12fe-41da-84e6-c72cb6d6769b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.125239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2574894-12fe-41da-84e6-c72cb6d6769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.143653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c2574894-12fe-41da-84e6-c72cb6d6769b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:58.144809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c2574894-12fe-41da-84e6-c72cb6d6769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:58.207569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:58.214800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 165/320] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:42:58.237706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9edb-5bf7-49b2-98ab-fb82708e0574 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.337863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9edb-5bf7-49b2-98ab-fb82708e0574 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:58.357849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df895-b0cb-45c8-9406-63e664c23cb5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.358209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df895-b0cb-45c8-9406-63e664c23cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.358464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df895-b0cb-45c8-9406-63e664c23cb5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.360773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 166/321] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:58.365370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.365863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.366221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.377768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:58.378347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.378652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.378871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.379996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:58.381474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:58.383045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 156/322] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:58.386044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:58.387467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:58.389367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.458328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 167/323] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:58.464442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:58.483249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.511152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d9e51-040e-4656-817c-a7bdd306d880 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:58.548199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:58.549101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.549540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.549950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] PATH_INFO: `/v3/groups` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.550613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:58.552055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:58.568548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 157/324] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Aug 4 06:42:58 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:42:58.600901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a02b-0178-4392-8084-01e00b2b1516 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:58.632369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:58.642485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:58.643507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.643988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.644459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.657648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1e5d000a-d5fa-429a-84be-df5c2fabc14d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:58.663295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:58.664237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:42:58.665085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:58.666615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 168/325] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:58.673027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.707576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28187f99-c4a9-4204-b7ef-927d4ec70294 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.707844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28187f99-c4a9-4204-b7ef-927d4ec70294 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.708120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28187f99-c4a9-4204-b7ef-927d4ec70294 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.709525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 169/326] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:42:58.715564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.715841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.716321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.736600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:42:58.737834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:42:58.800863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eaf20-2e28-463f-90d9-84abcdd55434 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:58.820338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 170/327] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:42:58.832147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:58.848431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:58.849136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:58.849400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:58.849687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:58.850405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:58.850704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:58.853174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:58.853286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.863749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 158/328] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:58.869167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:58.978700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6aa0-79f4-451a-9384-d719822061f5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:58.999410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d4c01-7a38-407e-9b68-b78c14edfb98 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:59.000541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:59.021284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.022055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.022333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.022605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.034794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:42:59.041416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:42:59.042471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:42:59.043964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:42:59.044705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.044800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 171/329] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:42:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:42:59.044877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.044877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.044877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] PATH_INFO: `/v3/users/c366a85a053f4278a9174bf21196be32` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.046030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=c366a85a053f4278a9174bf21196be32)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:59.047485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:59.049186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 159/330] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:58 2022] GET /identity/v3/users/c366a85a053f4278a9174bf21196be32 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:59.051339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:59.054980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:59.130706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:59.172014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8455bb-a29a-4b48-9cfe-626e16ae59d3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:59.204850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a301-9337-405c-851c-e24d21ae6cc3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:59.211580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.212327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.212703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.213141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.215528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:59.215528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:59.216905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:59.228807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 172/331] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:42:59.234405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:59.257731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.258689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.259191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.259781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.260847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] RBAC: Adding query filter params (role.id=89195211fe574d2f96f793a39364ed4d, user.id=c366a85a053f4278a9174bf21196be32, scope.system=all) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:42:59.261992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:59.264200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:59.282630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 160/332] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 06:42:59 2022] GET /identity/v3/role_assignments?user.id=c366a85a053f4278a9174bf21196be32&scope.system=all&role.id=89195211fe574d2f96f793a39364ed4d => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:59.289516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:59.364365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469c1a-41ea-4c11-8930-e5be5180a27f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:59.405187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.405852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.406131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.406404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] PATH_INFO: `/v3/users/3d4f7cf2a7ef4055a28428742066f753` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.407604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4f7cf2a7ef4055a28428742066f753)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:59.409177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4df88d-243f-4a90-921c-db3eb51515a8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:59.411163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 173/333] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:42:59 2022] GET /identity/v3/users/3d4f7cf2a7ef4055a28428742066f753 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:42:59.416662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:42:59.537336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4631-1a56-42ca-b70f-f94973004d76 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:42:59.547259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:42:59.572763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:42:59.573463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:42:59.574499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:42:59.574866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] PATH_INFO: `/v3/system/users/3d4f7cf2a7ef4055a28428742066f753/roles/95d1f6f8b06245a7a1757b5ec15589d0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:42:59.576311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d4f7cf2a7ef4055a28428742066f753, role_id=95d1f6f8b06245a7a1757b5ec15589d0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:42:59.577786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e70e5-f7bc-488b-8a58-a9c7ef8184b7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:42:59.588908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 161/334] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Aug 4 06:42:59 2022] PUT /identity/v3/system/users/3d4f7cf2a7ef4055a28428742066f753/roles/95d1f6f8b06245a7a1757b5ec15589d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:00.896466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f99e5-3de8-4834-96d7-087598aff896 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:00.896970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f99e5-3de8-4834-96d7-087598aff896 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:00.897064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f99e5-3de8-4834-96d7-087598aff896 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:00.898586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 174/335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:00.904756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:00.905280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:00.905351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:00.926051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:00.927238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:01.023581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 162/336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:01.065945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f99e5-3de8-4834-96d7-087598aff896 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:01.177485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f99e5-3de8-4834-96d7-087598aff896 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:01.186822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:01.218910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:01.219561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:01.219839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:01.220109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:01.232326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:01.237775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:01.238659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:01.239438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:01.240537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 175/337] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:01.244970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:01.378797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e77d-655f-4919-8cf3-366b4263c080 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:01.380320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:01.425624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:01.426265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:01.426541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:01.426810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:01.427524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:01.427826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:01.429373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2ff5-7f10-417b-8826-f1dfb0b7384c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:01.438264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 163/338] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:01.443976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:01.590140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6eef5-b5cf-477d-8faf-2c6d6791b64c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:01.615965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbf77-f73a-4bbc-8593-f705afc8d7d8 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:01.616284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbf77-f73a-4bbc-8593-f705afc8d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:01.616516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbf77-f73a-4bbc-8593-f705afc8d7d8 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:01.618153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 164/339] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:01.623602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:01.623885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:01.624162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:01.650559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:01.651115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:01.651393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:01.651666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:01.665282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:01.666479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:01.735594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:01.794544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:01.796039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:01.831596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 165/340] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:01.871399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:01.963230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 176/341] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:01.970819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.089708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.107689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d44e3-6117-497c-8e55-cc4fae5fa2e2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.110286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.169754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04cdec-f8cb-425a-bdd2-5a64fa68740b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.213417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.213992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.214335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.214610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.220306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:02.221683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.221811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:02.222355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.222633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.222902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.223863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 177/342] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:01 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:02.228806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.251822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e697410c-f786-4d76-964a-ef0b3add63fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:02.257585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:02.258490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:02.259281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:02.262095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 166/343] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:02.263710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1749e0-9f94-456a-a09e-42c15706eeef None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.264196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1749e0-9f94-456a-a09e-42c15706eeef None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.264739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1749e0-9f94-456a-a09e-42c15706eeef None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.271090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 167/344] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:02.271868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1749e0-9f94-456a-a09e-42c15706eeef None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.356282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d831885-85e5-4d8e-a014-4e40cd942a1f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.405767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.406438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.406717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.406991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.421202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.429767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:02.431297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600afbb0-2abd-4c97-b499-87f82708a132 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:02.433931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 178/345] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:02.435286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339189a6-b6c0-4a99-907d-7c5ffc9cc079 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.435570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339189a6-b6c0-4a99-907d-7c5ffc9cc079 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.436288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339189a6-b6c0-4a99-907d-7c5ffc9cc079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.458702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1749e0-9f94-456a-a09e-42c15706eeef None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.461789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-339189a6-b6c0-4a99-907d-7c5ffc9cc079 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:02.463029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-339189a6-b6c0-4a99-907d-7c5ffc9cc079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:02.519449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.520000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.520275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.520545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.521296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:02.521599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:02.523519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:02.533688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 168/346] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:02.534536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.564024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.565655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 179/347] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:02.567931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a7f1-8a43-4c20-aa08-2d8bb52130b8 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.568248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a7f1-8a43-4c20-aa08-2d8bb52130b8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.568554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a7f1-8a43-4c20-aa08-2d8bb52130b8 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.570283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 180/348] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:02.570984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a7f1-8a43-4c20-aa08-2d8bb52130b8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.650573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3b37-60ac-4f8a-9203-5d3fd76670bb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.686428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a7f1-8a43-4c20-aa08-2d8bb52130b8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.687182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.687961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.688246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.688521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.689456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=1fe8de6a1053497ab83417b274c6ca85) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:02.689768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:02.691357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876fda8-6979-4f02-9f95-c603f3e43a97 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:02.699161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 169/349] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=89195211fe574d2f96f793a39364ed4d => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:02.700603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.700890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.705402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.723874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.730931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.731933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.732426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.732859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:02.743860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:02.745084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:02.812245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:02.814128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:02.823151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 170/350] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:02.824598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.851071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.940564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 181/351] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:02.941448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:02.947703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3caea2-47e6-4897-a6ce-3d3ef24d2e1d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:02.982817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:02.991791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:02.992673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:02.993119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:02.993549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.005750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b8c96afb-3683-4efe-b306-2987cfe5c891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:03.010916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:03.011915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:03.012744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 171/352] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:03.013706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638046-6df5-4ad1-abea-2826de7ff521 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.014118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638046-6df5-4ad1-abea-2826de7ff521 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.014522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638046-6df5-4ad1-abea-2826de7ff521 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.016140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 172/353] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:03.017041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638046-6df5-4ad1-abea-2826de7ff521 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.061393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692d2d-46ad-4806-aac4-669f6f90ad1d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.099692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.104508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.105549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.106114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.107069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.118985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4ad82e6d-ef4b-439c-84a8-f293adc63341 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:03.125222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:03.126093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 06:43:03.126890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:03.131989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 182/354] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:03.133555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.134040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.134551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.135256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638046-6df5-4ad1-abea-2826de7ff521 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.156004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:03.157696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:03.183476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.183476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.183476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.183476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.184088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.185536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.188180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 173/355] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:03.188958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.264674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 183/356] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:03.266154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.296267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.321213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3659f8-9eb3-4d35-b5b3-0a8bbebf31b9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.365867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.366491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.366773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.367044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.367906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:03.369150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.370597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.377437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.382069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 174/357] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:03.385025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.414237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa0f4a-f241-452e-ab47-e010a354c3cf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.462655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.463285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.463564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.463834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.464869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:03.465194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.466819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.476339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 184/358] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:03.477763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.523406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6de2-18c7-446b-99e7-c5dcc34558c1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.571343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.572117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.572384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.572647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.573181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.575569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.577194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.579014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 175/359] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:03.579716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.596597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d91a-62af-4e5c-9b89-c667a756b21d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.644958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.644958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.645249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.645490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.660178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:03.664479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:03.665653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:03.666664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:03.668018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 185/360] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:03.668673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.724430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724c8d-5591-46e4-9999-10885e892614 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.775087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.775716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.775993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.776267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.809423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba9e8-ea75-4419-9485-9b947bdbc420 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:03.854641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.856279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.857695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:03.858632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.859813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.860095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] PATH_INFO: `/v3/users/3d4f7cf2a7ef4055a28428742066f753` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.861336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4f7cf2a7ef4055a28428742066f753)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:03.862744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249641b2-cd82-43fe-af8c-2f5ec6162d32 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:03.864960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 186/361] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/users/3d4f7cf2a7ef4055a28428742066f753 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:03.866581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37fa5d-ef9e-4750-b138-ca1e5f07c4fe None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:03.866849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37fa5d-ef9e-4750-b138-ca1e5f07c4fe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:03.867123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37fa5d-ef9e-4750-b138-ca1e5f07c4fe None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:03.868945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 187/362] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:03.873966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37fa5d-ef9e-4750-b138-ca1e5f07c4fe None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:03.886987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.942872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:03.987996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 176/363] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:03.989133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.005356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37fa5d-ef9e-4750-b138-ca1e5f07c4fe None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.046111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.046704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.046981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.047257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.048042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=1fe8de6a1053497ab83417b274c6ca85) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:04.048347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.050450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.057520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 188/364] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=b145351ec6374b099e83fb311cea5308 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.058941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.110987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83a45-2983-49e2-855d-e28de6b50e64 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.153392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.154193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.154547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.154894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.155766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:04.156144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.157767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703d28-6e7d-4c63-b0c9-f415f0d4ec3d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.166054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.167833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 177/365] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.170008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.170494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.171348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.192013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:04.193594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:04.200832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db1acc-79cb-4ec2-a728-431d10ad59c0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.225806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.247622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.248413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.248786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.249200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.250081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] RBAC: Adding query filter params (role.id=95d1f6f8b06245a7a1757b5ec15589d0, user.id=3d4f7cf2a7ef4055a28428742066f753, scope.system=all) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:04.250509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.252056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.268541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 189/366] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/role_assignments?user.id=3d4f7cf2a7ef4055a28428742066f753&scope.system=all&role.id=95d1f6f8b06245a7a1757b5ec15589d0 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.270094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.305414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 178/367] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:04.308763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.461144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69828878-f51a-4427-9250-d61ee8da0b3b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.461458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6deeb7-8658-45a7-9501-bb4ff4896ec0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.499271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.505876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.506354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.506982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.507145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.507238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.507514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.507870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.508307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.509678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.511377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.513288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 190/368] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.514341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.556051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.602221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.603932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.656157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa61e3-8028-4acb-8269-9929e2d97543 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.706120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.706782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.707054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.707318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.729936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:04.737614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:04.738484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:04.739294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:04.741981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 191/369] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:04.742982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.766041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 179/370] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:04.768997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.820633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.843293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:04.868887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77eb9-6416-4099-a5d7-792a5118f63b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.889059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff2eb8-32ad-467d-949a-41840bae9016 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:04.906050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.906463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.906745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.907018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.908175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.910816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.912805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 192/371] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.913709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:04.929559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:04.930759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:04.931235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:04.931831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:04.932743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:04.933429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:04.935264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:04.944523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 180/372] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:04.945644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.029432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82655220-3140-43a2-9cfb-1fb775c8ca50 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.057251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60870-834b-444a-841e-e578d36fd146 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.057903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.067518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.068050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.068679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.069101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.070614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.072146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.076559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 193/373] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:05.077592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.086296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.100178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.101159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.101606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.102021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.102961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=bd9905bef5f44abe8b6c660ba483de07) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:05.103414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.105931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.112850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 181/374] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:04 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=89195211fe574d2f96f793a39364ed4d => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:05.114414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.197471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d79617-d0d0-482f-9c7b-290234c9da74 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.234611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e5edb-7ee5-42a9-aea3-e58578d6cf30 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.235769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.236507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.237052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.237380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.275289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.276182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.277180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.277600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.279279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.281387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761b20c-e34a-44e6-97b9-9eff29fb7509 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.283685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 182/375] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:05.285463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074da8-4c48-472a-ab8c-0c9377ce05ff None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.286003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074da8-4c48-472a-ab8c-0c9377ce05ff None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.286478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074da8-4c48-472a-ab8c-0c9377ce05ff None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.288557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 183/376] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:05.289701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09074da8-4c48-472a-ab8c-0c9377ce05ff None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.308796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.317588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.319142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bacba-ce62-4878-9b81-5c51dec1a6d2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.363262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.425047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09074da8-4c48-472a-ab8c-0c9377ce05ff None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.470625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 194/377] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:05.472204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.472651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.473119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.474534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.475299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.475652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.475991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.476859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=bd9905bef5f44abe8b6c660ba483de07) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:05.477258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.478786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.488065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 184/378] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=b145351ec6374b099e83fb311cea5308 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:05.488966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.499226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:05.501423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:05.600138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 195/379] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:05.633126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb6a7-116d-4890-a356-9864705a03c6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.634786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.671930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.695573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:05.705437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.708831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.709239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.709523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] PATH_INFO: `/v3/projects/0cb3b87528e24f6496c89253b8f1df0e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.713206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb3b87528e24f6496c89253b8f1df0e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.714742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.722283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 185/380] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/projects/0cb3b87528e24f6496c89253b8f1df0e => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:05.730698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.835705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4a5e-05c9-486c-a7f4-950e3106a08e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.896876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eaa81-3c71-49c7-a6bd-a9c28b5a45f5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:05.924887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.925575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.925854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.926126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.935245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:05.935899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:05.936180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:05.936456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] PATH_INFO: `/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:05.947601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] RBAC: Authorizing `identity:get_group(group_id=032a0a8e8a684c60b7ef63e1cd25608d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:05.949928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:05.951631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 186/381] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:05.952527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:05.957765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:05.958644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:05.959431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:05.960028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:05.960791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 196/382] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:05.978904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:06.061800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:06.130642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:06.137105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097f26-af03-4eaa-9a9c-1150f539c7e1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:06.171182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50099d6-f6c9-4721-af83-8d5055408958 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:06.189509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:06.190147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.190850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.191147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.191919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] RBAC: Adding query filter params (group.id=032a0a8e8a684c60b7ef63e1cd25608d, role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=0cb3b87528e24f6496c89253b8f1df0e) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:06.192224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:06.193690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:06.204144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 187/383] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/role_assignments?group.id=032a0a8e8a684c60b7ef63e1cd25608d&scope.project.id=0cb3b87528e24f6496c89253b8f1df0e&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:06.248712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:06.249402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.249679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.249948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.250673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:06.250972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:06.252351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:06.265388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 197/384] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:06.271184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:06.434056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214404-9e37-45f6-b298-43aa8bd62eff None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:06.455325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:06.481103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:06.481755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.482034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.482372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.483519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:06.484961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:06.486925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 188/385] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:06 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:06.492367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:06.624729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95293a1-eabe-46c9-9e40-69ef4a5c5dc3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:06.660359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:06.661047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.661334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.661607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.662767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:06.664272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf71b9-cf0d-47c9-9f29-d709c51cf593 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:06.666344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 198/386] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:06 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:06.672830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:06.764802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a7f0-d462-44d7-bab2-f4c4ced0b202 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.765148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a7f0-d462-44d7-bab2-f4c4ced0b202 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.765413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6a7f0-d462-44d7-bab2-f4c4ced0b202 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.766758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 199/387] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:06.772066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.772632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.773151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.803498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:06.805074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:06.830153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:06.848678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac68c-5102-462e-8e26-e0ca2659de42 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:06.930781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 200/388] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:06.937641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:06.938676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:06.939174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:06.939657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/groups/410677fa60744b43a62d768e203e5af2/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:06.946286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, group_id=410677fa60744b43a62d768e203e5af2, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:06.947977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:06.954617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:06.977274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 189/389] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 06:43:06 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/groups/410677fa60744b43a62d768e203e5af2/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:43:07.091800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399f9b-e911-47a6-bd6c-a9ec7ea77b10 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:07.135371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:07.136838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:07.137034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:07.137306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:07.166459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:07.171668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:07.172639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:07.173562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 201/390] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:07.179086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:07.263655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:07.338717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3f60-0b12-443d-a3d8-b0ebcef25dca None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:07.379842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:07.380473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:07.380755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:07.381072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:07.381767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:07.382069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:07.383462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:07.395509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 190/391] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:07.400927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:07.414462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:07.528841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ba46-9412-49e5-a380-b1b812573dfa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:07.569642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:07.570555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:07.570989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:07.571422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:07.572799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:07.574576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:07.576727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 202/392] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:07 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:07.582111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:07.732040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277707d-1d59-4b63-9202-81d189d7d887 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:07.741281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:07.778838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:07.779546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:07.779771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:07.780046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:07.781346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:07.782801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8201b-fcd9-4624-b084-d2a977a6fe2f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:07.784789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 191/393] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:07 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:07.790329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:07.890216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:07.923192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94575415-a73e-4af3-a001-45c1f45779df None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:07.972310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:07.973015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:07.973303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:07.973579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85/groups/410677fa60744b43a62d768e203e5af2/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:07.976006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8de6a1053497ab83417b274c6ca85, group_id=410677fa60744b43a62d768e203e5af2, role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:07.977544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47af6be-8677-4ff5-9a15-9f683066aabd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:08.003016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 203/394] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 06:43:07 2022] PUT /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85/groups/410677fa60744b43a62d768e203e5af2/roles/b145351ec6374b099e83fb311cea5308 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:08.052748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0a9c-5db1-4a5e-8d58-2781cfe11ee2 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.052944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0a9c-5db1-4a5e-8d58-2781cfe11ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.053256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0a9c-5db1-4a5e-8d58-2781cfe11ee2 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.054956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 192/395] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:08.060549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.060836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.061141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.084635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:08.085869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:08.111872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9dad-db59-4100-8a37-3a57e8ab4495 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.112182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9dad-db59-4100-8a37-3a57e8ab4495 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.112430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9dad-db59-4100-8a37-3a57e8ab4495 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.113961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 193/396] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:08.120750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.121079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.121370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.160285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:08.161526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:08.207662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 204/397] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:08.277044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.279573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 194/398] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:08.303603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.361968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:08.406626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067d430-7ad4-4aee-b058-8b11a5e7bb4c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:08.424952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a45f73-01b8-4cc5-8d06-fcc4d14cd936 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:08.426777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:08.449578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:08.450520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.450950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.452172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.474929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:08.484659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:08.485929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:08.486911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:08.490992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 205/399] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:08.496426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:08.497395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.497903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.498334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.499876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.527976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:08.539134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:08.540234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:08.541215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:08.546675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 195/400] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:08.575684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.698087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8806-bdab-4317-ac90-9d2907f5d4f5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:08.745373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:08.763211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a540500-da0e-4ff2-97ed-c4293015a9fe None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:08.767923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:08.768557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.768833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.769154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.769869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:08.770168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:08.773944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:08.788960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 206/401] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:08.795556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.839968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:08.840603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.840878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.841425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.842140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:08.842440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:08.843813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:08.852463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 196/402] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:08.859769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:08.889571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:08.943284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41beb8-23e6-48b3-b49b-967ae5266d15 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:08.988205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:08.988858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:08.989158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:08.989426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:08.990719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:08.993073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:08.994834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 207/403] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:09.000841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.039578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a89a-c454-444d-b5d9-175efa054beb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.079956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.080735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.081098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.081373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.082528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.089283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.089283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 197/404] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:09.096412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.128179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.186413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e3efb-6edd-4a6c-862a-5e19319debd7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.222736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.223495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.223761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.224039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.225321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.226739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaf9bf-13a6-4a97-b4f6-c20574a93a53 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.228646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 208/405] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:08 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:09.233809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.235857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d757-892d-4b71-b614-8e30ba79fd6a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.236147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d757-892d-4b71-b614-8e30ba79fd6a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.236428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d757-892d-4b71-b614-8e30ba79fd6a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.240673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8772b-f7c9-4d60-87e5-9e587183fcf7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.242598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 209/406] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:09.243446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9d757-892d-4b71-b614-8e30ba79fd6a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.277137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.277726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.278002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.278273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.279413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.281012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681af67-08e8-420e-818b-cc74bc574d2b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.283051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 198/407] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:09.289213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.289496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.289770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.310240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:09.311545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:09.352122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9d757-892d-4b71-b614-8e30ba79fd6a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.378043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.392640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.393343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.393620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.393896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/groups/410677fa60744b43a62d768e203e5af2/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.395268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 199/408] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:09.396310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.396943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, group_id=410677fa60744b43a62d768e203e5af2, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.405678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.429174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 210/409] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 06:43:09 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/groups/410677fa60744b43a62d768e203e5af2/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:09.451271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.498465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.509979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2f29-929b-4412-ab9f-e131297b685c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.549151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.550063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.550180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.550366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07/groups/410677fa60744b43a62d768e203e5af2/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.552714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd9905bef5f44abe8b6c660ba483de07, group_id=410677fa60744b43a62d768e203e5af2, role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.554145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402b1a-3dec-4928-b75f-db91ff389d36 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.569207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 200/410] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 06:43:09 2022] PUT /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07/groups/410677fa60744b43a62d768e203e5af2/roles/b145351ec6374b099e83fb311cea5308 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:09.577416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7ae6-e15f-496d-bef0-8d84e797e23e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.577778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7ae6-e15f-496d-bef0-8d84e797e23e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.578061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7ae6-e15f-496d-bef0-8d84e797e23e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.579442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979771-b1f5-428a-8088-d03d68eb02e1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.579943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 201/411] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:09.585564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.585841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.586114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.621991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:09.623145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:09.633174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.633835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.634122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.634392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.651348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:09.659183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:09.660171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:09.661000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 211/412] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:09.666722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.707402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 202/413] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:09.720042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.735578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.797648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb12a3-c58d-4c00-8526-59d01647c12e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.833209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:09.834190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.834890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.835241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.835578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.836362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:09.836733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:09.838216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:09.854367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 212/414] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:09.856350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.861509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f88ba-f31f-4e69-af75-0469f3212052 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.903859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:09.904423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:09.904696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:09.904962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:09.921697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:09.928230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:09.929158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:09.929949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 203/415] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:09.937317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:09.977015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6972b4-8de4-4804-9e98-a14f23082bcd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:09.979367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:10.014320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.014916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.015202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.015466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] PATH_INFO: `/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.016634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] RBAC: Authorizing `identity:get_group(group_id=032a0a8e8a684c60b7ef63e1cd25608d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:10.018679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:10.024347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 213/416] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:10.027094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.055594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48442408-d86b-4dcf-a5aa-62a82e13b8e9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:10.102772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.103995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.104904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.105734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.106716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:10.107221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:10.109683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:10.126595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 204/417] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:10.134018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.140744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:10.175949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d811a-5948-425e-9e4f-3234585a363e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:10.242979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.243606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.243890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.244223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] PATH_INFO: `/v3/projects/0cb3b87528e24f6496c89253b8f1df0e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.247162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] RBAC: Authorizing `identity:get_project(project_id=0cb3b87528e24f6496c89253b8f1df0e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:10.248604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:10.254446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 214/418] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:10 2022] GET /identity/v3/projects/0cb3b87528e24f6496c89253b8f1df0e => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:10.260102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.305725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ea6e-9ed6-4b9b-91eb-ded4cf3b1c02 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:10.334748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:10.375759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.376857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.377472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.377949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.419964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c98a5-4d98-4885-99a4-ed4985d3186c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:10.456111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.456757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.457063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.457391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] PATH_INFO: `/v3/projects/0cb3b87528e24f6496c89253b8f1df0e/groups/032a0a8e8a684c60b7ef63e1cd25608d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.460141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb3b87528e24f6496c89253b8f1df0e, group_id=032a0a8e8a684c60b7ef63e1cd25608d, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:10.461717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361637f-1366-4b38-8d5d-572f8ba0168c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:10.478454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 215/419] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 06:43:10 2022] PUT /identity/v3/projects/0cb3b87528e24f6496c89253b8f1df0e/groups/032a0a8e8a684c60b7ef63e1cd25608d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:43:10.479815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be76c-5df2-43ac-bfa3-da1c38e2788d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.480104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be76c-5df2-43ac-bfa3-da1c38e2788d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.480431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be76c-5df2-43ac-bfa3-da1c38e2788d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.482114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 216/420] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:10.496430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.496798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.497198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.518790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:10.520004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:10.571942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:10.573732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:10.576254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:10.605146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 217/421] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:10.631334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.673396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:10.768379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f215b3-8c8e-4e68-9453-c472dde44867 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:10.781829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 205/422] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:10.789149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.817701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:10.818355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:10.818635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:10.818908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:10.844920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:10.849907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:10.850978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:10.851938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 218/423] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:10.860522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:10.993802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.005583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e9cd-a437-4c0a-91a6-0f6a74aef9fe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.014878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ffce-8588-48ba-805b-196151eb3b1b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.021356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.049687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.050364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.050644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.050911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.051622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:11.051922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.055846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.072645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 219/424] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:11.087438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:11.102786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.103446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.103716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.103982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.105465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.106953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.114106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 206/425] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:10 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:11.119784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:11.296503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f68ed-a63c-47a9-bf1b-55613d61e5b8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.322207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d4ac-34b6-4f2a-a25e-0ca36f14963a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.344605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.346408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.348239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.349528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.381454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.382471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.383739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.384215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.387180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.388905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.393996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.395008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 207/426] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:11 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:11.400956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:11.479949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.480619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.482060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.580744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0134f3-c805-4139-980b-0e02d2ceae9b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.646359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.647803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.648082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.648360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.649172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=1fe8de6a1053497ab83417b274c6ca85) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:11.649482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.650913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.660502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 220/427] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:43:11.664034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 208/428] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:11 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=89195211fe574d2f96f793a39364ed4d => generated 611 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:11.666263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:11.737065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.788204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07c29d-2954-453a-88c8-482cd2c467ff None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.827898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:11.828574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.828856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.829159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] PATH_INFO: `/v3/projects/1fe8de6a1053497ab83417b274c6ca85` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.830366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe8de6a1053497ab83417b274c6ca85)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:11.831886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b894b-3969-45bd-ab8b-c05eadb1f270 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:11.833899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 221/429] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:11 2022] GET /identity/v3/projects/1fe8de6a1053497ab83417b274c6ca85 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:11.842404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:11.961350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d168c-f2b4-4d39-9306-07ff3b732757 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:11.962916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:11.992559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f50b1-1567-4f52-ae15-98b238ba7ad0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:11.992866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f50b1-1567-4f52-ae15-98b238ba7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:11.993153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f50b1-1567-4f52-ae15-98b238ba7ad0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:11.994715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 222/430] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:12.002169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e110c-8eb6-4a38-8681-d977ea4c9a76 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.002433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.002547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e110c-8eb6-4a38-8681-d977ea4c9a76 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.002716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e110c-8eb6-4a38-8681-d977ea4c9a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.003080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.003364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.003641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.004793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.006591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.008557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 209/431] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:11 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:12.018010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.031899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7f0e110c-8eb6-4a38-8681-d977ea4c9a76 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:12.033506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7f0e110c-8eb6-4a38-8681-d977ea4c9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:12.127443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 223/432] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:12.128807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880a6b-dc81-4569-9603-7db0ff2ae14f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.129157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880a6b-dc81-4569-9603-7db0ff2ae14f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.129432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53880a6b-dc81-4569-9603-7db0ff2ae14f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.130808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 224/433] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:12.136624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.136918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.137149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.154817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66fce-5019-40b8-8ca8-77df79030a66 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.156162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:12.157540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:12.197221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.198989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.199494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.199780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.200565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=1fe8de6a1053497ab83417b274c6ca85) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:12.200878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.202337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.208324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 210/434] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=1fe8de6a1053497ab83417b274c6ca85&role.id=b145351ec6374b099e83fb311cea5308 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:12.209021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.215094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.240932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 225/435] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:12.255217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.266706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.337261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a518e1-7200-4a1e-b782-1b591a4fb49b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.377796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.378371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.378646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.378919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.390379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:12.397099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:12.398248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:12.399110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 211/436] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:12.408020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.420751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061f2ea-6623-461f-93a1-6e635610ceeb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.473722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.474427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.474712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.474984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.489300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:12.495123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:12.496260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:12.497254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 226/437] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:12.504421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.536512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.545644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94958de-2be7-4177-af9e-d51c2a9c121f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.558993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.585563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.586573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.586573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.586735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.587607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:12.587714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.589370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.603162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 212/438] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:12.605580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.643047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66e41-02d1-4d59-8406-0c0f52a07765 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.687675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.687675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.687970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.688040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.689015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:12.689636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.691181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.702363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 227/439] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:12.710202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:12.746575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ff5de-8a66-4362-a794-f31811b0be9c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.790245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.791124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.791405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.791750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.827495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.852592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f662dc-2447-459d-a93c-1265aaa607e3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:12.854431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:12.877555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.879003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615caf4-9a3b-46df-8a5d-47b9440ff8bc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.894143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:12.895154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.895584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.895870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.965885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:12.967597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3547d2-68fb-440f-8dcd-a4d4b9e535f2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:12.983533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 213/440] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 06:43:12.984791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9d4c-4518-4b68-9e9e-fe40872985a1 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:12.985112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9d4c-4518-4b68-9e9e-fe40872985a1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:12.985393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9d4c-4518-4b68-9e9e-fe40872985a1 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:12.986754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 214/441] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:12.989271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9d4c-4518-4b68-9e9e-fe40872985a1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.045952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.066232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 228/442] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:13.067472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.067773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.068054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.074825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.087124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:13.088313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:13.095370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9d4c-4518-4b68-9e9e-fe40872985a1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.129396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.130030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.130307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.130580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.131720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.133191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.134827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 215/443] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:12 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:13.135642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.155804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 229/444] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:13.156563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.235798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656d43-5718-4b91-88a4-9fb5b07c6021 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.258914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.263769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb485-4c74-4cfc-b9a8-59a2af81dfa7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.270738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.271376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.271675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.271945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] PATH_INFO: `/v3/projects/bd9905bef5f44abe8b6c660ba483de07` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.273114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] RBAC: Authorizing `identity:get_project(project_id=bd9905bef5f44abe8b6c660ba483de07)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.274552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.276209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 216/445] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/projects/bd9905bef5f44abe8b6c660ba483de07 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.277235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.298573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.303826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.304469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.304747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.305050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.306198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.307684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.309279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 230/446] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.310025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.374845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ea3d-3648-4979-bcb6-ae734dd7145b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.408786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.409379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.409709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.409982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.415363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3410831-e832-4d30-83fd-68feabdcc3c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.420764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:13.425604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:13.426500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:13.427301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 217/447] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:13.427955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.454319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.454957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.455230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.455503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] PATH_INFO: `/v3/groups/410677fa60744b43a62d768e203e5af2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.456633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] RBAC: Authorizing `identity:get_group(group_id=410677fa60744b43a62d768e203e5af2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.458072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.459620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 231/448] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/groups/410677fa60744b43a62d768e203e5af2 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.460352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.487218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.525830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.533454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b1b4-8b77-40d8-8ebc-068a14556aad None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.559435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422fb43-ced7-4c5f-af2d-e59561262748 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.566921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.567528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.567804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.568073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.568849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=89195211fe574d2f96f793a39364ed4d, scope.project.id=bd9905bef5f44abe8b6c660ba483de07) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:13.569180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.570629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.576387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 218/449] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=89195211fe574d2f96f793a39364ed4d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.577168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.601613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.602566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.603117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.603538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.605334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:13.605811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.607550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.617775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 232/450] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.623769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:13.690860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d682-bb98-46de-848c-aabec4e6ca67 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.711025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.733231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.733231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.733501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.733654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.734439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] RBAC: Adding query filter params (group.id=410677fa60744b43a62d768e203e5af2, role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=bd9905bef5f44abe8b6c660ba483de07) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:13.734748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.736318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:13.742359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 219/451] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/role_assignments?group.id=410677fa60744b43a62d768e203e5af2&scope.project.id=bd9905bef5f44abe8b6c660ba483de07&role.id=b145351ec6374b099e83fb311cea5308 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:13.748623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ada6-55e1-4ce0-b458-3e8bed375ef8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:13.786037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:13.794909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:13.795568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:13.795852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:13.796128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:13.882473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:13.883983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:14.001360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 233/452] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:14.006902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:14.111987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d7fb4-67b7-4826-9cff-8eadb85265bd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:14.145666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:14.146301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:14.146580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:14.146854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] PATH_INFO: `/v3/projects/0cb3b87528e24f6496c89253b8f1df0e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:14.148011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] RBAC: Authorizing `identity:get_project(project_id=0cb3b87528e24f6496c89253b8f1df0e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:14.149494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:14.151703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 220/453] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:43:14 2022] GET /identity/v3/projects/0cb3b87528e24f6496c89253b8f1df0e => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:14.157182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:14.185842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:14.254474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683c470-185d-4757-aa57-68c5ac562a43 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:14.287311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:14.287945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:14.288226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:14.288499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] PATH_INFO: `/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:14.289646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] RBAC: Authorizing `identity:get_group(group_id=032a0a8e8a684c60b7ef63e1cd25608d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:14.291079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf622b-88cc-4216-9d06-fb7c74ef850b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:14.292836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 234/454] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 06:43:14 2022] GET /identity/v3/groups/032a0a8e8a684c60b7ef63e1cd25608d => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:14.298607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:14.347594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:14.405520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe182a-e782-4ac2-b6c4-b848dbeab20c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:14.438278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:14.438887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:14.439156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:14.439427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:14.440204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] RBAC: Adding query filter params (group.id=032a0a8e8a684c60b7ef63e1cd25608d, role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=0cb3b87528e24f6496c89253b8f1df0e) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:14.440511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:14.441962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88b80-d092-473f-941e-2acbf6aa2935 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:14.447465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 221/455] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 06:43:14 2022] GET /identity/v3/role_assignments?group.id=032a0a8e8a684c60b7ef63e1cd25608d&scope.project.id=0cb3b87528e24f6496c89253b8f1df0e&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:16.915721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bc1-df0d-4538-95e9-aa6f160bab39 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:16.916257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bc1-df0d-4538-95e9-aa6f160bab39 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:16.916257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bc1-df0d-4538-95e9-aa6f160bab39 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:16.918491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 235/456] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:16.923806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966303a4-7098-402f-a5d8-0f45be12795d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:16.924200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966303a4-7098-402f-a5d8-0f45be12795d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:16.924381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966303a4-7098-402f-a5d8-0f45be12795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:16.959942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-966303a4-7098-402f-a5d8-0f45be12795d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:16.961855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-966303a4-7098-402f-a5d8-0f45be12795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:17.108837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 222/457] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:17.110697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f8fe-4c2c-4103-902e-76f9bc662eb3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.111448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f8fe-4c2c-4103-902e-76f9bc662eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.112107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f8fe-4c2c-4103-902e-76f9bc662eb3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.122027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 236/458] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:17.127742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.128221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.128696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.131544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3f8fe-4c2c-4103-902e-76f9bc662eb3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:17.162816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:17.164016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:17.241544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:17.268677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:17.286630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3f8fe-4c2c-4103-902e-76f9bc662eb3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:17.320497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 223/459] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:17.346580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:17.347239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.347520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.347796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.367091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:17.368796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:17.371174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:17.387154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:17.388035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:17.388867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:17.388867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:17.388867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:17.388867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:17.388867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 237/460] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:17.394287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:17.501650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319693-0c9a-4b0b-80d1-830d136bc464 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:17.537419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570bd-9738-4915-a30a-523dd403688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:17.538397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570bd-9738-4915-a30a-523dd403688f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.538894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570bd-9738-4915-a30a-523dd403688f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.539382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570bd-9738-4915-a30a-523dd403688f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.540454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177570bd-9738-4915-a30a-523dd403688f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:17.540956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177570bd-9738-4915-a30a-523dd403688f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:17.543193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177570bd-9738-4915-a30a-523dd403688f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:17.556315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 238/461] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:17.562052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13870-50e3-4b59-adb9-ad2bc2ec9b2a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:17.564028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570bd-9738-4915-a30a-523dd403688f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:17.578230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:17.657661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:17.658323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.658653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.658926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.680619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570bd-9738-4915-a30a-523dd403688f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:17.684685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:17.686407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:17.725460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:17.726362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:17.727302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:17.727302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:17.727302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:17.727302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:17.734524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 224/462] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:17.742670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:17.762093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:17.764266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.765447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.766089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.768205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:17.770141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6e74-69d4-4824-b1c6-b1464a872f1a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:17.800126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:17.804113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 239/463] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:17 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:43:17.875720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21d82-e623-4d3c-bf87-eadc05f15814 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.876347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21d82-e623-4d3c-bf87-eadc05f15814 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.876846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21d82-e623-4d3c-bf87-eadc05f15814 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.878731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 240/464] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:17.887974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.888603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.889203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.920372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:17.921629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:17.930800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c53fb-e283-4616-8ccd-ec8594344fa6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:17.978082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:17.980136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:17.980657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:17.981166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:17.982078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:17.982584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:17.984212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:18.001488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 225/465] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:18.012688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:18.081372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:18.090188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 241/466] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:18.122670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:18.138387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:18.139297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e629b4-f001-4629-b180-6e0d58bedd4b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:18.181135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:18.181760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.182572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.182842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.183514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:18.185456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:18.218996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 226/467] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:18 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:43:18.313885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101065c-ed88-49be-acdc-adb1419f2873 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:18.355532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:18.356198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.356475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.356742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.368764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:18.371214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:18.394887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:18.395841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:18.396696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:18.396696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:18.396696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:18.396696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:18.396696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 242/468] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:18.402156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:18.524653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ae3-59fe-4cfe-bc0f-b2802d37e901 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:18.560469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:18.561475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.561964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.562435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.563356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:18.563872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:18.565531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a87b8-086b-4289-8aab-2204409cfd45 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:18.577339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:18.581011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 227/469] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:18.586748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:18.654692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:18.714066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92db98a-fae2-4d7b-a180-297941e622f2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:18.758144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832891-d3dd-4b39-ae99-dd6eb0430f1a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.758791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832891-d3dd-4b39-ae99-dd6eb0430f1a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.759284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832891-d3dd-4b39-ae99-dd6eb0430f1a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.761202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 228/470] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:18.766650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8305a-e260-48ea-8ee3-365f2c4d14f2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.767190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8305a-e260-48ea-8ee3-365f2c4d14f2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.767664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8305a-e260-48ea-8ee3-365f2c4d14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.769041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:18.769671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:18.769950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:18.770222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:18.770895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:18.772370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:18.798386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-58e8305a-e260-48ea-8ee3-365f2c4d14f2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:18.800034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-58e8305a-e260-48ea-8ee3-365f2c4d14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:18.815353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 243/471] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:18 2022] POST /identity/v3/users => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:18.903982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 229/472] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:18.941236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:19.080052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0be4-ad9d-4458-b650-110338070636 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:19.082669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:19.127543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:19.128201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.128486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.128768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.144840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:19.146344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:19.161176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:19.162044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:19.162901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:19.162901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:19.162901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:19.162901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:19.162901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 244/473] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:19.167180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0bed-7771-4129-ac75-cd50d40125b4 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.167850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0bed-7771-4129-ac75-cd50d40125b4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.168040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0bed-7771-4129-ac75-cd50d40125b4 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.169925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:19.170397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 230/474] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:19.174617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.174899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.175178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.194206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:19.195671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:19.282101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 231/475] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:19.313302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:19.315797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ebef-d1fa-4beb-a105-b4469afb6ae9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:19.377618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:19.378616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.379593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.380164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.382856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:19.383317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:19.385675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:19.411433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 245/476] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:19.417433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:19.451040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:19.457426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:19.556967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07bc7c-b065-4eb0-aca2-494d6c7932dc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:19.615040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:19.616442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.617235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.617920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.620045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:19.622995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:19.634581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.sql.core [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 06:43:19.634581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 06:43:19.634581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [parameters: {'id': 'adc2e6855bad472fa1405bad8b8e8fed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 06:43:19.634581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80212) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 06:43:19.637183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dad-f852-49c5-b10e-c514c262c2e0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:43:19.669493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:43:19.671126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application yield resource Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise self.value Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application session.commit() Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 06:43:19.672884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.flush() Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application compat.raise_( Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 06:43:19.674544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:43:19.678477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:43:19.681066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [parameters: {'id': 'adc2e6855bad472fa1405bad8b8e8fed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:19.689598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 06:43:19.693738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.702134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:19.702134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.702134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.702134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.702870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:19.702870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:19.707715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 232/477] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 06:43:19 2022] POST /identity/v3/roles => generated 144 bytes in 395 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:19.718010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:19.718836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 246/478] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:19 2022] POST /identity/v3/users => generated 249 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:19.920150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4c020-b9ec-4486-8d2b-391220ee5faa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:19.950989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:19.970889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:19.971550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:19.971826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:19.972142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:19.988167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d91acc16-9531-492d-bb26-6093ff20488e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:19.993289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:19.994152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:19.995577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 233/479] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:20.000798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:20.076462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:20.109413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01771e-9707-40f9-b4aa-8d0d596b8c1d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:20.144881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:20.145540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:20.145821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:20.146097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:20.146813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:20.147117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:20.148478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50f8c-19e3-4415-9d53-aece5bb37920 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:20.158248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 247/480] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:20.538346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c0bb-ab81-4297-a461-8cecadb66003 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:20.539372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c0bb-ab81-4297-a461-8cecadb66003 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:20.539867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c0bb-ab81-4297-a461-8cecadb66003 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:20.542093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 234/481] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:20.546983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:20.547276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:20.547552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:20.570047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:20.571525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:20.663375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 248/482] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:20.717017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c0bb-ab81-4297-a461-8cecadb66003 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:20.852865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c0bb-ab81-4297-a461-8cecadb66003 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:20.892555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:20.893220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:20.893497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:20.893764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:20.911353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d0e312fa-8b0d-44e7-8207-cde5b386a2ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:20.916791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:20.918189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:20.918981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:20.922829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 235/483] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:20.924254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.017088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58c05-7d71-4586-8002-ec35be001d2c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.017408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58c05-7d71-4586-8002-ec35be001d2c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.020053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58c05-7d71-4586-8002-ec35be001d2c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.023723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.033700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 236/484] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:21 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:21.040102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.040377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.040646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.070009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:21.071189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:21.089623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a457-1e13-4a69-9af4-be2991f5e49d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.143368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.147330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.147955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.148232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.148503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.149239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:21.149537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.151553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.169203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 249/485] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:21.177952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.196750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 237/486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:21.232954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.318672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a60f-caa5-4903-a75e-d88188ca11ce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.348515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.355414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe7eb-61da-4218-b8a7-9f8ff9fb0ea2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.359643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.360420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.360737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.361039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.375927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.377591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.392220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.392858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.393161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7104dbbc-c58d-43d7-b9ca-1998caa2b643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:21.393461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:21.394280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:21.395119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:21.395119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:21.395119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:21.395119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:21.395325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.395389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 250/487] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:21.396262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3b5f9-1af9-4285-acd4-b1e397d67c8b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.401022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3b5f9-1af9-4285-acd4-b1e397d67c8b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.401022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3b5f9-1af9-4285-acd4-b1e397d67c8b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.401022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 251/488] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:21.403759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.404109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.404452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.409529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:21.415061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:21.417409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 238/489] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:21.419067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.426223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:21.427578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:21.454393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.508521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 252/490] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:21.509654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.531676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d88f7-925e-4b76-b3d2-b57f4ff59e60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.568359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.569020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.569287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.569557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.570299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:21.570602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.572060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.585186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 239/491] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:21.590565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.622319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282dc36-b2eb-4833-9f4f-8e702eafa581 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.632284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.659645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.660199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.660478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.660753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.661491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:21.661792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.663279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.673116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 253/492] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:21.674331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.703506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.711793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d980-c89d-4128-835e-a49a8b973744 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.756956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.758197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.758654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.759075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.778275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:21.785419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:21.786499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:21.787465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:21.790325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 240/493] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:21.792342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.800006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c832-2b75-4668-a646-6accf40c2c53 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.835703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.835703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.835998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.836230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.844762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.846250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:21.859003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:21.859973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:21.860879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 254/494] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:21.865409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.897435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:21.909491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de0c3-516b-4127-8948-a578676d7f64 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.945385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:21.946132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:21.946511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:21.946882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:21.957777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:21.959413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:21.973014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58069b7d-24c2-4e82-a919-4ae43ef3068b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:21.976101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:21.977123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:21.978165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:21.978165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:21.978165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:21.978165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:21.979868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 241/495] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:21.980744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:21.989979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.014448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.015165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.015444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.015717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.016587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:22.016863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.018262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.031388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 255/496] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:22.032259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.089898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd914b9-6712-48c1-a477-fdd680945c5e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.125539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.126533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.127011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.127480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.128496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:22.129019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.130666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.131027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.141938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fe539-627a-449c-b019-3167ea1cbec0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.170016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 242/497] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:22.171174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.182247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.183019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.183224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.183498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.184194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:22.184495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.185975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.200147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 256/498] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:22.200953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.240739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.280396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910e337-6134-48f3-924a-43b2b93f99f5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.312705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d62a33-ed9e-4bc9-a01f-6d2b046a58a1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.316607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.317514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.317994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.318458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.330012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.331841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:22.349008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:22.349877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:22.350718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:22.350718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:22.350718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:22.350718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:22.352553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 243/499] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:22.353637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.361974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.362676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.362964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.363453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.390912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.445098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.445098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e8a96-9472-49fd-bbd0-52d202c2d32f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.466225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1cee-7fe0-4670-aced-2c028c5fa80a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.484373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.503423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.504067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.504352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.504628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.512798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.514266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:22.528165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:22.529107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:22.530026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:22.530606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 244/500] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:22.531494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.560485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 257/501] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:22.561854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884b52-abf7-4367-9b34-cfc5a9274eea None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.562200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884b52-abf7-4367-9b34-cfc5a9274eea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.562478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884b52-abf7-4367-9b34-cfc5a9274eea None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.563867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 258/502] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:22.564446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884b52-abf7-4367-9b34-cfc5a9274eea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.624781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.649788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0bab9-7227-438a-b29e-e10e05a8a010 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.676387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884b52-abf7-4367-9b34-cfc5a9274eea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.691402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.692025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.692304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.692576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.693296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:22.693696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.694978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.708393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 245/503] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:22.708393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.722790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.723339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.723616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.723885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.724668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:22.724971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.726426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39474-43f4-4f7d-9ee5-3d7e460b0c0d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.750846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.762838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 259/504] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:22.764126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79cfbf-8e3a-4ee9-a213-9c6710740c0e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.764471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79cfbf-8e3a-4ee9-a213-9c6710740c0e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.764748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79cfbf-8e3a-4ee9-a213-9c6710740c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.781890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2e79cfbf-8e3a-4ee9-a213-9c6710740c0e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:22.783089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2e79cfbf-8e3a-4ee9-a213-9c6710740c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:22.815128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370fbec-549e-46bc-a6a7-c4d7fcd661ce None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.848657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 260/505] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:22.848933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:22.849592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.849910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83b57-6b42-4837-ac17-942fe2ace9ca None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:22.850006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.850188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.850287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83b57-6b42-4837-ac17-942fe2ace9ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:22.850459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e83b57-6b42-4837-ac17-942fe2ace9ca None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:22.856605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 261/506] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:22.856605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e83b57-6b42-4837-ac17-942fe2ace9ca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.863482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:22.864957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:22.882281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:22.883220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:22.884063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:22.884063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:22.884063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:22.884063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:22.884063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 246/507] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:22.884327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:22.903012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.966181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e83b57-6b42-4837-ac17-942fe2ace9ca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:22.975205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:22.988182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c3cec-aa3b-4468-b454-b5a1aa141eb1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.000358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.001016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.001298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.001574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.008442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.009954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4a28aef4-76b8-4628-86b3-ad20dbd56c59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:23.021393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:23.022425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:23.023328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:23.023830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.023830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.023968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 262/508] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:23.024032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.024032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.024157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.024157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.024282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.043179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:23.044372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:23.094220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.095665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.109162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 263/509] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:23.110140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.140662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.182404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.195415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 247/510] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:23.196224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.207079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ecf13-a4e6-440b-b70b-0c8a4e76ff4d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.240097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.240667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.240942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.241244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.251677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:23.256545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:23.257500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:23.258301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 264/511] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:23.258955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.298246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144f73-4ae5-411b-8d75-09aca3f59d68 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.332028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.332643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.332931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.333230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.333912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:23.334214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.335583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.346018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.346913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 248/512] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:23.347782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.356127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0a71-d14e-4e72-bd26-07f82e7daf8e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.389971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.390591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.391270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.391550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.392340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:23.392653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.394156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.399793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.412287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 265/513] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:23.413181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.452033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157af3a-a92b-40ad-aeae-2dc929abf38d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.487498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.488130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.488404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.488685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.499364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.500802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.512601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b200-5501-4afe-a5ec-5a2db44b2db6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:23.515407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:23.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:23.517116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:23.517116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:23.517116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:23.517116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:23.517116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 249/514] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:23.517756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.547002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.547643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.547924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.548199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.558289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.559735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.568048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:23.575145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:23.576004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:23.577236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:23.577236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:23.577236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:23.577236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:23.577236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 266/515] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:23.577646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.625615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.629553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebd5eb-7917-4f99-a3d1-e41390dd2818 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.664606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.665245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.665508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.665779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.666856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:23.667164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.668563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.676537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 250/516] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:23.677144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.681121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c93e8-43d1-407e-bd6b-3d31b0be7c2f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.716959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.717621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.717904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.718176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.724796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.726281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:23.739147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:23.740168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 267/517] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:23.741063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.787349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016706-af3a-484e-86cc-d5f4d9f17799 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.802170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.821230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.821835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.822111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.823108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.844142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef866-db10-4c08-9258-8943b0f978b3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.852377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:23.876652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:23.877296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:23.877654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:23.877842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:23.878529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:23.878832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.880218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.891002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:23.892307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 268/518] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:23.892418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:23.892892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:23.988666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829a4a2-e2c5-49c0-8968-bbf82d005c00 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:23.989345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 251/519] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:23.990233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.013402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.027185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.027791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.028067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.028337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.029037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.029338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.030682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.046076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 269/520] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.046076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.055167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.095228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3f199-fb64-4622-a753-120cf895735b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.129133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.129769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.130047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.130319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.140243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa43a9-0820-41c6-848f-fcfdfc52cb0e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.140663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.142141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:24.156440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:24.157314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:24.158174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:24.158174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:24.158174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:24.158174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:24.158174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 252/521] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:24.158438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.175845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.176470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.176753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.177059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.177805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.178111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.179563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.197991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 270/522] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.198807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.239440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.255754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4007de-95b5-4565-80ac-33ccbe110c4d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.269341 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.289920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.290533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.290809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.291644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.292475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.293930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.298125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09fb5-8c50-4e67-9d88-4be847297371 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.315025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 253/523] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:24 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:24.315913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.341863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.342545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.342823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.343096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.355009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.356503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:24.377726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:24.378691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:24.379655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:24.379655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:24.379655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:24.379655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:24.382876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 271/524] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:24.384350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.439975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d02d2-4518-477f-9af0-3b1334c4cf77 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.489143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.489808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.490049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.490311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.497366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.498797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.506053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:24.515656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:24.516671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:24.517532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:24.517937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6b79-e217-4ff2-b5d9-5bc0225734f0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.521269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 254/525] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:24.523012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.556095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.558322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.558951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.559230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.559559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.560248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.560549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.561942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.574586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 272/526] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.575406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.635524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5603f97-2ab6-43d3-9bac-ba6d8c07999a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.670839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.671459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.671713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.671985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.672803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=18b61207b59f467596d6457eb998244d) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.673094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.674505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.682041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 255/527] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/role_assignments?user.id=18b61207b59f467596d6457eb998244d&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.682679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.694034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce676f-8b48-4882-9bd8-efcfd1d92da6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.753127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.753781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.754061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.754329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.755495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.755805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.757247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.776387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 273/528] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.777153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.795374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.819355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:24.830457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94600b-3ee2-4aae-9741-57d989c113db None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.884090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.885355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.885637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.886329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.887123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:24.887438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.889428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.902187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e51f0b-1d72-4389-9890-eeb32e736fb9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:24.919347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 256/529] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:24.920512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:24.940070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:24.940927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:24.941307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:24.941686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:24.949940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:24.951553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:24.964130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:24.965042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:24.966204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 274/530] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:24.970833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.042028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87d79-e9b0-4b20-9061-e44759037dcf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.059420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.084170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.084890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.085504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.085785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.091897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7019b-5cb5-4415-a294-c0efc3fde6df None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.095761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.097234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:25.112025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:25.113516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 257/531] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:25.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.133298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.133911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.136473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.136759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.137099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.138568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=fa7cd29afc2344ecbe9557ecb43b2801) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:25.139793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.141276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.150242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 275/532] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:24 2022] GET /identity/v3/role_assignments?user.id=fa7cd29afc2344ecbe9557ecb43b2801&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:25.151079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.272779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43075a62-31fe-433a-a917-4ffe889e90c3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.312108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.313133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.313609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.314071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.315050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:25.315567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.317217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.321433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e8d9-f497-4323-b949-1769a40a9336 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.340460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 258/533] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 06:43:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:25.346020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.363966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.365356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.366078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.366573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.367715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:25.368541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.370558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.378728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.392404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 276/534] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:25.401392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.463903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.527827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837f489-c940-4ff4-b4e6-8b0069391210 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.585032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6b49b-d593-4caa-859d-7341460ffbda None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:25.603682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.604227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.604507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.604775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.653430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:25.654053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:25.654331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:25.654601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:25.656649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:25.656959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.658410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.671639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 277/535] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:25 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:25.740169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:25.741673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:25.828878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.863476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 259/536] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:25.870811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:25.959991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:25.988744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71b181-ea54-41a2-bd5e-06377747d9a3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:26.024526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:26.025264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.026159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.026448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.037324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:26.039078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:26.053971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:26.054837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:26.055668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:26.055668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:26.055668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:26.055668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:26.055668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 278/537] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:26.062067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:26.175897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44d7b-0b62-4919-8124-915950e1e36e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:26.213419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:26.214043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.214320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.214596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.215297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:26.215601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:26.217245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:26.229039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 260/538] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:26.234522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:26.341196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec218ce-8bc4-4277-b18e-4922bb1410b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:26.357331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:26.378985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:26.379692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.379975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.380247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.387477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:26.388937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:26.401357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:26.402227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:26.403091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 279/539] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:26.414074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:26.470976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:26.568869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf85a-6721-4b49-8e2a-602a9eeea1eb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:26.633674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:26.634298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.635096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.635373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.636120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:26.636421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:26.637868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685fc75-5c2a-4b20-b176-8d2d8d20f1b8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:26.660418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 261/540] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:26.666019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:26.774607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339557-221c-4ca3-8fbe-bf6af703b6f3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.775141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339557-221c-4ca3-8fbe-bf6af703b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.775141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339557-221c-4ca3-8fbe-bf6af703b6f3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.777051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 262/541] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:26.786328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.786614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.786890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.821770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad22ab8-2d56-4bed-8a5e-2f50e008223e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:26.828792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:26.830020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:26.856523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:26.857287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.857574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.857849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.858638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=23d27ceb5baf4b71b2ae60975e787151) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:26.858948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:26.860383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211d139-cfdf-423e-8d50-d447750b1ea8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:26.866376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 280/542] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:26 2022] GET /identity/v3/role_assignments?user.id=23d27ceb5baf4b71b2ae60975e787151&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:26.960974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876fa3-d402-4327-b368-98f753447a4a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.961314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876fa3-d402-4327-b368-98f753447a4a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.961560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876fa3-d402-4327-b368-98f753447a4a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.963673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 281/543] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:26.971241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:26.971543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:26.971816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:26.980673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 263/544] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:27.004280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:27.004634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.005530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:27.042726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.078976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.155641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 282/545] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:27.175817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.193897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2f521-9dfb-42f9-ae60-9741013fa35d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.262995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.263888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.264310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.264722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.282525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:27.289911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:27.291518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:27.292586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:27.298975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 264/546] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:27.307088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.358284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e41337-8cde-4239-86eb-6b37e1bd2d8c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.398476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.399398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.399865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.400402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.412303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:27.419482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:27.420582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:27.421623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:27.423993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 283/547] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:27.429969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.469348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.507442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.537961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a91a3-78be-4751-8b60-8cdcd913ffcc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.567150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346ae6-f71c-4e5c-a829-41a35b4cbf33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.584096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.584992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.585285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.585946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.586678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:27.586986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:27.589059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd2b7-3f7e-4cba-9aac-2d320c2c5c09 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:27.600734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 265/548] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:27.602793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a905-39fb-43f0-9b16-dffdb34626fa None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.603076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a905-39fb-43f0-9b16-dffdb34626fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.603989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a905-39fb-43f0-9b16-dffdb34626fa None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.605378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 266/549] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:27.609267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8a905-39fb-43f0-9b16-dffdb34626fa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.612331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.612955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.613258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.613526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.614231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:27.614530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:27.615883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61a99e-ae16-4da8-bf5a-b4597a894a26 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:27.625152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 284/550] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:27.626511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.626803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.627076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.646096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:27.647270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:27.722466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 285/551] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:27.723651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.752255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8a905-39fb-43f0-9b16-dffdb34626fa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.754619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.800410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.801125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.801644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.801644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.816935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:27.818522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:27.830235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:27.838344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:27.839374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:27.840212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:27.840212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:27.840212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:27.840212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:27.842657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 267/552] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:27.843685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.851500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b40c4-25e1-4f2b-8a4d-57ca5a415e77 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:27.891556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:27.892572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:27.893089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:27.893557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:27.905359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:27.907185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:27.923609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:27.924513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:27.925562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:27.925562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:27.925562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:27.925562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:27.932578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 286/553] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:27.932578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:27.967415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118e00b-82f8-41f7-9415-496aea96f4a6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.003028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.004069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.004543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.005034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.015917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:28.020468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:28.022020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:28.023303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:28.024315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:28.024933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 268/554] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:28.026278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.070417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e047-bd18-4c82-b0e3-285fb6fb5d59 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.096172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.114751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.115132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.115420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.115696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.116391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.116769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.118094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.136792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 287/555] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.136792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.172166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1af9-983f-4d42-9ec5-478b52061441 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.218567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.219535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.220475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.221008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.222363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.222876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.225247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.243129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 269/556] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.245138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.248753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ea4a-054c-4114-a1b4-29b613ec9cf1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.281876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.288258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.289359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.289642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.289915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.291569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.291833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.293309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.306532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 288/557] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.306532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.381597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b34a-518a-42c1-809b-1aa6c2fcbb29 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.402123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.421348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.421988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.422256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.422529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.427332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e082-e6f8-4cc9-8f0d-19d4db1d9293 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.430689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.432643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:28.446115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:28.448186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:28.449174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 270/558] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:28.450528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.468241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.468900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.469224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.469569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.477599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.479445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f07c7923-43d9-4095-b1a3-12edcaba22ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:28.490976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:28.491954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:28.493034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:28.497428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 289/559] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:28.498709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45b0f-1816-474a-b27c-ddb7bff39ce3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.499002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45b0f-1816-474a-b27c-ddb7bff39ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.499281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45b0f-1816-474a-b27c-ddb7bff39ce3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.500568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 290/560] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:28.501280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45b0f-1816-474a-b27c-ddb7bff39ce3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.562087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.565273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d25e-968b-4451-a136-db1dc4543bf4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.601911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.602547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.602825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.603097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.614034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.615480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.624783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45b0f-1816-474a-b27c-ddb7bff39ce3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:28.631531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:28.632515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:28.633878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:28.633878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:28.633878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:28.633878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:28.637123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 271/561] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:28.638145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.663372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.663991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.664265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.664536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.665340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.665688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.667091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8155f-5c41-43c7-91c9-9411e3a79199 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.668804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.685797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 291/562] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.686526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.686818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.687090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.705098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:28.706627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:28.759505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737741dd-d0d8-40e4-83f1-e4b8d6eb6411 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.789006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 292/563] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:28.789006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.806768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.807693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.808016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.808283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.810125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.810125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.811100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.829668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 272/564] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.830335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.840430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.901816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3f0ae-1d55-4c6f-bafe-3af9212cf1a2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.921976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:28.938114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.938732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.939007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.939277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:28.939558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37f57-9eb5-4bb4-9827-b64d4529db28 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:28.939955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:28.940253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:28.941633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:28.958130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 293/565] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:28.959020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:28.977671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:28.978482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:28.979003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:28.979459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.047318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.048953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.057934 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.060839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47651e-2a49-408f-b47c-1056c1d342b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.094457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.095191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.095465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.095753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.105498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:29.110719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.111744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 294/566] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.112690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.137911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.153459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 273/567] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:29.154199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.210274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981441c9-b41b-4fe6-8f96-17a3ad444e58 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.242627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.243265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.243549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.244336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.252524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fb6f-0b14-4b9a-806a-9b9f2ddae2bb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.254762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.256200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9e8e0e6c-61fd-4f2d-914d-5c1a2c0fe6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:29.270948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.271819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.272702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:29.272702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:29.272702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.272702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:29.272702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 295/568] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.273243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ca0c-f778-4893-9553-04c1cab76bf2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.273506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ca0c-f778-4893-9553-04c1cab76bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.273897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ca0c-f778-4893-9553-04c1cab76bf2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.275298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 296/569] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:29.275959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535ca0c-f778-4893-9553-04c1cab76bf2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.290293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.293021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.293666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.293941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.294215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.301209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.302648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:29.314647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.315769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 274/570] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.321743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.360935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.378228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535ca0c-f778-4893-9553-04c1cab76bf2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.411306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.411844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.412117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.412388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.413115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:29.413412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.414301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddff8-6961-4506-951a-65cf9f961524 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.414754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.422689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 297/571] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:29.423455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.453509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.454151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.454430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.454701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.465106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.466820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9e80c9af-395d-46bc-ae06-4430d23fa941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:29.481184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.482249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.483359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:29.483359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:29.483359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.483359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:29.483359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 275/572] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.483647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.483714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.483952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.501752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:29.502935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:29.511840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.538627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1c78-c4dc-4f53-8f93-0e85a83ea6ae None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.569306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 276/573] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:29.570211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.571572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.573110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.573496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.573877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.574671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:29.575084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.576552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.589596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 298/574] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:29.590411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.608454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.678943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc85cd-089d-4d4c-a286-409a269a8d57 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.689292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cd5e8-501f-49e7-bdef-3e7514ce18a4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.713345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.713966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.714231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.714498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.715272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:29.715832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.717311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.724054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.724686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.724964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.725258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.727090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.734627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 277/575] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:29.735430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.735912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.737379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:29.752827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.753958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 299/576] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.755048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.820349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.834804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7663fe-33ec-4041-bc5f-897d1f269d19 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.858953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b484-cd6a-4254-8ec1-60016e22a0e0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:29.870101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.870715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.870991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.871263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.871950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:29.872249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:29.873694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:29.884762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 278/577] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:29.885568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.891887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:29.892533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:29.892813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:29.893121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:29.903093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:29.908392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:29.909448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 300/578] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:29.910320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:29.955499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:29.989018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ab6c1-8323-4f5e-8717-da491146fc60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.007768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013c22-38e8-4f2a-a185-8626facfb00d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.022202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.022833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.023109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.023387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.032314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.033775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.040709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.041552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.041830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.042103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:30.044772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.045709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:30.046595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 279/579] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.047068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.054232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.055554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.055694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:30.070466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.071633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 301/580] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.073973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.151284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a54eba-a3f8-4601-878f-217f63f2ecca None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.171932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.176099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18a1-ba60-4b0c-b105-4b38dc34f4f4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.184709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.185362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.185645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.185925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.186613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:30.186919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.188291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.201049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 280/581] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:30.201690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.214701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.215263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.215790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.216067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.222513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.223937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:30.235018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 302/582] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.237058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.270042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.303259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c909-eb30-48ec-88d3-ba214209b3d5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.337313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d9f8-a97d-40ad-9c4f-dc183d1d1124 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.338556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.339163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.339437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.339706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.340402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:30.340950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.342327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.350375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 281/583] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:30.351329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.372642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.373296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.373586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.373858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.374592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:30.374897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.376307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.387822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 303/584] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:30.388597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.407123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.450309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba8f3-343c-49ec-bdad-8f3a089d8123 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.476336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.486031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.486647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.486926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.487199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.487881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:30.488185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.488707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719284f-0c62-41fb-a7d1-a5001a3e7335 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.489591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.503505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 282/585] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:30.505657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.523842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.524484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.524763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.525117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.531982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.533437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:30.546187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.547169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 304/586] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.548175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.612263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2432d-5568-402f-9409-f2bc0c220385 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.625911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.646962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.647578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.647733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4daaf-1c91-40b9-ba2a-af9e7038d9cc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.647859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.648133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.648873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:30.649216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.650889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.662447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 283/587] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:30.663209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.684793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.685491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.685776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.686055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.696819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.698293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:30.713363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.714279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.715182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:30.715182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:30.715182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:30.715182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:30.715182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 305/588] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.715471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.721035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.770781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6548a-6853-4e07-b99a-ced56b65f10c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.805170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.805827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.806125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.806428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/18b61207b59f467596d6457eb998244d/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.815778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967d31-6118-4a39-876a-97e0f3d46a30 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.821404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=18b61207b59f467596d6457eb998244d, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.823088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.835404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 284/589] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:30 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/18b61207b59f467596d6457eb998244d/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:30.836200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.843935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.850782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:30.851446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:30.851772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:30.852688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:30.861787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:30.863346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:30.875693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:30.876729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:30.877662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 306/590] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:30.878140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:30.961679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:30.967542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301108-e28a-435d-8179-d23cdc916e66 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:30.995738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95ae8-a32e-43ee-98f3-52d35108e049 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.009295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.009940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.010219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.010483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.011264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.011566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.013034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.031969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 285/591] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.032840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.036599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.037282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.037566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.037840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.038632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=df74ba7216d64aa081a8ce2fbccb7b3a) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.038946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.040386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.053019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 307/592] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:30 2022] GET /identity/v3/role_assignments?user.id=df74ba7216d64aa081a8ce2fbccb7b3a&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.053019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.128878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.182258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319fa7-a029-4e35-b0e5-a39acc602028 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.195014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45a74-4bb5-4cfe-904a-be18e775c4eb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.222083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.222850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.223254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.223621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.224316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.224621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.226021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.233882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753733-589a-4732-90a3-b8346a48697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.234508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753733-589a-4732-90a3-b8346a48697c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.234795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753733-589a-4732-90a3-b8346a48697c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.235062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753733-589a-4732-90a3-b8346a48697c None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.235814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753733-589a-4732-90a3-b8346a48697c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.236203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753733-589a-4732-90a3-b8346a48697c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.237651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753733-589a-4732-90a3-b8346a48697c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.238982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 286/593] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.240026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.260031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 308/594] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.260031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753733-589a-4732-90a3-b8346a48697c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.269375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.376496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753733-589a-4732-90a3-b8346a48697c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.380027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb35ed-eef9-4131-8678-6d44a72bcc10 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.393340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.420102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.420795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.421102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.421374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.425378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.426246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.426719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.427201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.432561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.434075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.437467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.439371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:31.449385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:31.450276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:31.451149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:31.451149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:31.451149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:31.451149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:31.451149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 287/595] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:31.451856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:31.457262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:31.458213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:31.459162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:31.461966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 309/596] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:31.463770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.530745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.574082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bec8b1-48c3-4c63-b93a-cf410639dfe3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.594520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0b60-1631-483a-ad23-22fe8cc747e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.620397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.621338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.621885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.622331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/fa7cd29afc2344ecbe9557ecb43b2801/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.632903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.633748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.634215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.634690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.635630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.636080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.637656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.638094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=fa7cd29afc2344ecbe9557ecb43b2801, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.639731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.657977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 288/597] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:31 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/fa7cd29afc2344ecbe9557ecb43b2801/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:31.658759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 310/598] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.658908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.659890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.733187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.795963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628aa1b-88ed-4b48-a41e-d3a277a25065 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.819518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:31.841242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.842559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.843000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.843413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.844352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:31.844816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.846768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:31.873263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 289/599] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:31.875512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:31.897574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75727cd-adb1-4d05-8306-c680a7f02f7d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:31.977896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:31.979546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:31.979546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:31.979750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:31.991645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:31.993120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.004440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65dcf-fb71-4f79-90a8-dc755b767477 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:32.006042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:32.007090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:32.008258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 311/600] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:32.013041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.049598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.050391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.050764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.051133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.062840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.064417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:32.079933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:32.081094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:32.082167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:32.082167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:32.082167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:32.082167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:32.083305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 290/601] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:32.088841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.115297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:32.119492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:32.126373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51d16-aa99-43f5-b0fb-3207be072361 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.162870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.163811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.164257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.164779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.166375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:32.167016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.168594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.182687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 312/602] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:32.188597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.197041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d126-2ae6-4820-b03b-3a0720884d23 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.233868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.234627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.234996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.235632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.236239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:32.236636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.238235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.251301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 291/603] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:32.256546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.298215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabbc-e8d9-48a5-bc4e-e2742b4434ee None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.343359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.344386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.344841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.345288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.350573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:32.364651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7063-a45e-4f4e-ae4f-7ade555d7776 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.376149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=2245988d98b1408bba171ce6979796b0, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.377983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.395884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 313/604] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:32 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:43:32.403782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.404598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.404974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.405424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.413993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.415731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:32.429247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:32.430407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:32.432239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:32.434200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 292/605] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:32.440450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.444671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:32.601969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3867aad-c840-4cd9-a3c5-a0f207ed6631 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.639447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.640222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.640604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.640999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.641848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:32.642261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.643786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f03247-cc60-4263-96fe-a86dfc7ad49b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.655986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 314/606] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:32.661766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:32.766595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ec66f-d324-4248-8cec-cbe21d5608dd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:32.801280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:32.802112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:32.802497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:32.802873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/23d27ceb5baf4b71b2ae60975e787151/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:32.818701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=23d27ceb5baf4b71b2ae60975e787151, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:32.820415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae959e-9603-49ab-8c8b-6c9629986eb4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:32.840374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:32.845527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 293/607] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:32 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/23d27ceb5baf4b71b2ae60975e787151/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:33.073682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1052-f4ed-4bd7-90ae-eb42b1b6d546 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.074123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1052-f4ed-4bd7-90ae-eb42b1b6d546 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.074521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1052-f4ed-4bd7-90ae-eb42b1b6d546 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.076113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 315/608] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:33.082014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.082402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.082799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.102707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:33.104174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:33.197742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 294/609] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:33.229207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc1052-f4ed-4bd7-90ae-eb42b1b6d546 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:33.322249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:33.377604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc1052-f4ed-4bd7-90ae-eb42b1b6d546 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:33.422304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:33.422959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.423238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.423511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.441404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fc13422c-afbb-4485-9e01-eee670a303a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:33.447330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:33.448446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:33.449331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 316/610] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:33.455548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:33.628729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991a67-5200-482c-81e0-25e2bcdead33 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:33.667606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:33.671061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376db-5e2f-4319-a04d-ee0df82c59f9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.671680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376db-5e2f-4319-a04d-ee0df82c59f9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.672110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376db-5e2f-4319-a04d-ee0df82c59f9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.673913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 317/611] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:33.678423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:33.679053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.679165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.679385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.679480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.679658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.679748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.680299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:33.680596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:33.682024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:33.699483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 295/612] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:33.701354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:33.702707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:33.704810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:33.797774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 318/613] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:33.842212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:33.911481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:33.922512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3ca0-0294-4349-8dd4-2133f2c1b927 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:33.972897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:33.973578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:33.973853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:33.974125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:33.986861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:33.988379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:33.998314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16684-6a22-41ff-b188-cda8cf8c2bb1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:34.007002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:34.007905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:34.008807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:34.008807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:34.008807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:34.008807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:34.008807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 296/614] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:34.016563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.061696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.062338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.062612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.062878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.081443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:34.086270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:34.087719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:34.088549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:34.092879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 319/615] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:34.096243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.097218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.195238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc56b-d8dc-432f-bbd7-f6f2896685ec None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.217142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65911-e62b-4499-b2e8-3d68840f8dcc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.232348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.253178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.253799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.254091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.254354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.255059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:34.255399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.256707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.265932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 320/616] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:34.268563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.273025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.273926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.286911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 297/617] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:34.307653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.389928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a639f4-6b98-4ad6-9209-3bce71943f4e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.424400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.425073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.425356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.425631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.437003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.438582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:34.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:34.455764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:34.456681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:34.456681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:34.456681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:34.456681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:34.456681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 321/618] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:34.462242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.504384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.516595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ba5e2-35e8-4f46-8ab2-57522a270c7f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.518318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.569842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.570813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.571272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.571888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.580043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.582002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a0e9e369-92a3-48bc-9173-628d3735b0b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:34.595651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:34.596635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 06:43:34.597634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:34.598326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2080ef-64f9-449a-858e-d4629841eee2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.600817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 298/619] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:34.602307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1dc4-237c-4e16-8c8b-334c41d630d1 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.602777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1dc4-237c-4e16-8c8b-334c41d630d1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.603797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1dc4-237c-4e16-8c8b-334c41d630d1 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.605737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 299/620] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:34.606879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1dc4-237c-4e16-8c8b-334c41d630d1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.642185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.642765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.643108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.643511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.644229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:34.644746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.646459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6bd9d-3508-4035-b9dd-6a033a6957c8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.659598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 322/621] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:34.660941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.661348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.661683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.682199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:34.683481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:34.723739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1dc4-237c-4e16-8c8b-334c41d630d1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.753129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 323/622] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:34.759202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.762197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.763154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.763716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.764191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.765211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:34.765721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.767352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.786970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 300/623] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:34.793429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:34.796394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.820188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:34.888947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c21c2f-612b-442c-a906-cbecb104460e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.908593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4a9e3-36cf-4ad2-ad45-4fd63818efea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:34.925535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220aca-be54-4881-97e7-642794478976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.926181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220aca-be54-4881-97e7-642794478976 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.926457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220aca-be54-4881-97e7-642794478976 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.926734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220aca-be54-4881-97e7-642794478976 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.934555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d220aca-be54-4881-97e7-642794478976 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:34.935984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d220aca-be54-4881-97e7-642794478976 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:34.944311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:34.944937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:34.945244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:34.945518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8d220aca-be54-4881-97e7-642794478976 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:34.948408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:34.949374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 324/624] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:34.950337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220aca-be54-4881-97e7-642794478976 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.022207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.023564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.034462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.046091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.065873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220aca-be54-4881-97e7-642794478976 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.107018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.108083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.108646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.108929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.121552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-89e18086-0616-495a-a9bc-0d3ce47f1200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:35.126975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:35.127924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:35.128756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 325/625] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:35.130041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f519a-2efc-4c4d-aae7-1bd3190a6456 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.130041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f519a-2efc-4c4d-aae7-1bd3190a6456 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.130041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f519a-2efc-4c4d-aae7-1bd3190a6456 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.136151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 326/626] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:35.136151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f519a-2efc-4c4d-aae7-1bd3190a6456 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.139751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 301/627] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:35.141527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.247496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f519a-2efc-4c4d-aae7-1bd3190a6456 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.250728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558c9b-4cfa-467a-a2c4-40fd79862c9d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.272326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.283337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.283953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.284226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.284493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.285310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:35.285611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.287021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf3914-70e7-450c-9de9-ec1107fa609c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.290288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.291164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.291725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.292226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.293172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:35.293958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.295264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.295696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.313069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 327/628] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:35.313069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.313069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.313069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.313470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 302/629] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:35.313470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.329572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:35.330835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:35.398125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 328/630] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:35.399295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.435435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d520b3-6c27-479e-a437-845c5da3dbd6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.470295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.470919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.471192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.471459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.482414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.483845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:35.498428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:35.499472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:35.500537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:35.500537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:35.500537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.500537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:35.500537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 303/631] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:35.500884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.513596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671091b2-79ec-4a6e-b31f-a67aa0fba7a7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.538816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.538956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.548244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.548893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.549206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.549480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.560704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.562171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-192d538b-4415-47e1-ac9d-5ecc56e10b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:35.577605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:35.578640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:35.579544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:35.579544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:35.579544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.579544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:35.579544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 329/632] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:35.580105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad9c2-dd8b-4968-9247-1189af4e3636 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.580260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad9c2-dd8b-4968-9247-1189af4e3636 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.580493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ad9c2-dd8b-4968-9247-1189af4e3636 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.581784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 330/633] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:35.582480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ad9c2-dd8b-4968-9247-1189af4e3636 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.610544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcafaa-f7cc-4b1a-acbe-d4a0cc92e29b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.642999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.643625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.643899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.644176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.654323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.655752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:35.670805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:35.671765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:35.672657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:35.672657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:35.672657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:35.672657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:35.672657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 304/634] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:35.673112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.687165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ad9c2-dd8b-4968-9247-1189af4e3636 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.722823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.723547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.723837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.724117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.734664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:35.740026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:35.741150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:35.742009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 331/635] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:35.742689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.763512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.778910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0374-8a3d-47c4-ac34-ff8da0077a7d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.780412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.812064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.812670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.812945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.813249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.813921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:35.814218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.815565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da609d-6eda-4e17-b105-9a6607c330bc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.828224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 305/636] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:35.829395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.829673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.829944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.839613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9bfe9-a1f4-411a-bb45-5e5e97cad795 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:35.847050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:35.848210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:35.872700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:35.873352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:35.873629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:35.873984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:35.874664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:35.874967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:35.876312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:35.888802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 332/637] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:35.889649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.914238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 306/638] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:35.915080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:35.984509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:35.988720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8459e1-ff21-4813-b735-3b686ed8ca99 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.001320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.022409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.023030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.023311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.023543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618953e-3398-4b8e-ac49-1fafd6ae5090 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.023646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.024284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.025151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.026523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.037567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 333/639] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.038355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.058650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.059273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.059546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.059824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.060523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.060823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.062275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.069978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 307/640] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.070736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.134859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f413be5-40bd-4d8e-8ecc-6dc05b58ccee None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.168358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.169022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.169309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.169585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.171526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f9d2-82ad-4af6-8860-15ec32a7f10a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.176041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.177506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:36.188668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:36.189596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:36.190492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 334/641] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:36.190996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.205068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.205691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.205965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.206258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.210439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.213479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.214898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.216831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:36.227463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:36.229291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 308/642] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:36.230190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.290051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfcd1-4cd6-4477-8f91-3357b18452af None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.324736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.325325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.325598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.325870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.331271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584f3f-b76b-4895-99aa-46530734193f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.335741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:36.342042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:36.343165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:36.344058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 335/643] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:36.344780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.366757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.367387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.367660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.367935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.375765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.377221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:36.388917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:36.390095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 309/644] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:36.391183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.427020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.447985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.448888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa229-d5c4-4e2c-908e-f29bca103db5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.482677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d418-4077-4def-9277-f54575e3341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.483316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d418-4077-4def-9277-f54575e3341e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.483600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d418-4077-4def-9277-f54575e3341e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.483879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d418-4077-4def-9277-f54575e3341e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.490541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d26824-c663-4ca9-9f98-e51e8200de64 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.495207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644d418-4077-4def-9277-f54575e3341e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.496661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644d418-4077-4def-9277-f54575e3341e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8644d418-4077-4def-9277-f54575e3341e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:36.511194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:36.512284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 336/645] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:36.513249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d418-4077-4def-9277-f54575e3341e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.528159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.528773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.529077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.529354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.530088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.530411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.531858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.544605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 310/646] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.545404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.623161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644d418-4077-4def-9277-f54575e3341e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.647451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b922c-6adc-49e5-914b-486fac3891db None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.650024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.655710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.656401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.656678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.656948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.657712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.658017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.659417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.666295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.672036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 337/647] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.672827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.689817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.690561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.690915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.691252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.692023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.692387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.693842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.704296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 311/648] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.705114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.770346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80d29b-afb3-4c90-a9f9-e74d9a483e1a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.804277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.804884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.805186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.805457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.806331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.806629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.807200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b8ed-9539-443a-bd5b-eee405306072 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.808034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.825130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 338/649] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.825913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.841960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.842569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.842840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.843110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.843785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.844084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.845481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.857596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 312/650] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.858331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.877021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.900411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:36.928158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894ecc-ed83-44ad-8c6c-86b1d4b51424 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.959539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015baff-cd41-412e-a27b-d6985da28b1b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:36.962523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.963138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.963418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.963692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:36.964467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=18b61207b59f467596d6457eb998244d) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:36.964774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:36.966507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:36.972101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 339/651] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/role_assignments?user.id=18b61207b59f467596d6457eb998244d&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:36.972868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:36.994768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:36.995451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:36.995724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:36.995989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/df74ba7216d64aa081a8ce2fbccb7b3a/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.011955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=df74ba7216d64aa081a8ce2fbccb7b3a, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.013436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.027647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 313/652] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:36 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/df74ba7216d64aa081a8ce2fbccb7b3a/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:37.028431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.124087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a5035-7d7c-4ac2-8c91-afc376e4d67d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.140657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.161280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.177353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d143d6-1e1d-4c56-bc07-8c0057dd31f0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.184055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.184720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.185053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.185292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.201231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.203090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:37.220611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:37.221607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:37.222535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:37.222535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:37.222535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:37.222535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:37.222756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.222756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.222756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.222756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.223092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 340/653] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:37.223092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.300846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.302487 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.350389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3745-8573-4b1c-a80a-4524b40a0fc0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.389338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.389985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.390266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.390538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.398673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.400126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.409311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:37.412176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:37.415774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 341/654] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:37.418251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.425069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 314/655] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:37.427952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.449336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.528935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3e0f2-f1ea-40cd-81b9-a2a786a0df59 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.568749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.569078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a58cf-266c-4a51-88b0-29d7fa93773b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.569982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.570468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.570954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.571904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:37.572519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.574148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.589170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 342/656] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:37.590340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.607211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.607928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.608187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.608455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.619481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.621008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:37.636712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:37.637754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:37.638699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:37.638699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:37.638699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:37.638699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:37.642445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 315/657] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:37.643368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.689728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.689984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.711122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5bea-adb1-4191-8f87-cd183b61a97f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.748902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.749379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fc7fa-e4db-4fba-9770-95ee46ecaa0f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.749816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.750195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.750563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.751454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:37.751877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.753445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.776189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 343/658] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:37.777310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.785528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.786229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.786502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.786768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.795846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.797368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:37.809363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:37.810549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 316/659] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:37.811737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.886391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4f50-304f-4125-b11e-3b31a8c38c27 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.916831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41184034-e36d-4a99-b9ba-e1c00bb6b486 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:37.918326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.921869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.922603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.922982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.923369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:37.924155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:37.924588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:37.926075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:37.938266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 344/660] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:37.939175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:37.944859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:37.963171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:37.964164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:37.964584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:37.965031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.038447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.041294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.045314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adcc45-4213-4686-81f3-d1cddaa2ae2d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.079590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.080359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.080738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.081164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.082052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:38.082459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.083989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.103699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 345/661] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:38.104763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.153926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 317/662] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:38.155065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.157447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.169521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.211766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06274a-fd2d-4679-b973-918b96acc739 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.251383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.251928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.252210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.252483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.259982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.261480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:38.272970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:38.274090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:38.275133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:38.278894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 346/663] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:38.279072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c6f2-ead2-4939-8476-daad23e8138a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.279740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.318475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.319367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.319794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.320317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.381569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237caf-f620-472e-84f8-5b1240e01144 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.399043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.400928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.402657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.404036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.418944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.419747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.419961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.420238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.431530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.433065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:38.449038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:38.450110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:38.451178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:38.451178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:38.451178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:38.451178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:38.451178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 347/664] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:38.451459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.516000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 318/665] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:38.517234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.557684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062138bf-4397-439c-ad4b-5b578b01ed0a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.594851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c409-d151-4727-8921-953317d9288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.595478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c409-d151-4727-8921-953317d9288a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.595764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c409-d151-4727-8921-953317d9288a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.596046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c409-d151-4727-8921-953317d9288a None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.596798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c409-d151-4727-8921-953317d9288a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:38.597139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c409-d151-4727-8921-953317d9288a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.598568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c409-d151-4727-8921-953317d9288a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.613039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 348/666] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:38.617910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c409-d151-4727-8921-953317d9288a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.626781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa827-2cab-43f3-85f1-ad806d12a92e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.628710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.654167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.666926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.667766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.668298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.668750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.669600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:38.670044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.671775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.685325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 319/667] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:38.686354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.730184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c409-d151-4727-8921-953317d9288a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.767591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.768142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.768426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.768702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.780325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.781812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:38.799700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:38.800794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:38.801848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:38.801848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:38.801848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:38.801848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:38.801848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 349/668] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:38.802119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.802800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7341ae8-51c3-4401-86d3-02c59121d992 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.840185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:38.841348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:38.841783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:38.842385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:38.843338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=fa7cd29afc2344ecbe9557ecb43b2801) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:38.843829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:38.845475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:38.853046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 320/669] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/role_assignments?user.id=fa7cd29afc2344ecbe9557ecb43b2801&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:38.854213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:38.894215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.927091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:38.961824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5b20-1a4d-445a-8e65-a3606cf88ffa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:38.971134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2de11-ab46-4361-afaa-bf47b56ffbdb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.010158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.011178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.011692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.012116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.012956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:39.013440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.015228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.030485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 321/670] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:39.030871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.031604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.031950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.032233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.035530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.041819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.043279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:39.073918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:39.074998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:39.076035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 350/671] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:39.082155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.136445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.154595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73df20-b3e5-4c0e-a9c1-adc4b27b245d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.191278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.192180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.192619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.193070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.201704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.203356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7288bd26-039f-4aa2-8d8a-35562586b340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:39.218883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:39.219996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:39.221132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 322/672] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:39.225316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82d61-3a5d-4038-a50a-b19e75b21ff2 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.225738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82d61-3a5d-4038-a50a-b19e75b21ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.226146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82d61-3a5d-4038-a50a-b19e75b21ff2 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.228234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 323/673] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:39.229864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335590d-a95b-4d0a-b956-76f2fb437f6e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.230962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335590d-a95b-4d0a-b956-76f2fb437f6e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.230962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335590d-a95b-4d0a-b956-76f2fb437f6e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.231923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 324/674] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:39.234928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335590d-a95b-4d0a-b956-76f2fb437f6e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.251521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b11a-3a25-4e1f-aa93-bb61b9acf3ee None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.286078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.286621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.286900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.287174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.287981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:39.288292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.289797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce982c7c-4e90-41f0-9ec3-323482721be1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.302159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 351/675] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:39.303358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e330f-7658-463a-a5b5-2e91368b4379 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.303643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e330f-7658-463a-a5b5-2e91368b4379 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.303919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e330f-7658-463a-a5b5-2e91368b4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.312335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.325461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-185e330f-7658-463a-a5b5-2e91368b4379 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:39.326685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-185e330f-7658-463a-a5b5-2e91368b4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:39.356542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335590d-a95b-4d0a-b956-76f2fb437f6e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.392969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.393708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.394051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.394388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.401179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 352/676] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:39.401351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:39.401351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.401523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.401523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.401523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.401778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.413320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 325/677] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:39.414267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.421040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:39.422247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:39.423854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.496421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 353/678] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:39.497295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.527125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d571c8-30da-4348-9d3e-13e36d3501be None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.562774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.563402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.563678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.563949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.564777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:39.565110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.566570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.573057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 326/679] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:39.573835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.582286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.635839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3c80-53af-4df4-9865-9b6f575d77ad None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.672453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.675945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.676587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.676919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.677290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.678087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=23d27ceb5baf4b71b2ae60975e787151) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:39.678395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.679906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.686987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 354/680] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/role_assignments?user.id=23d27ceb5baf4b71b2ae60975e787151&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:39.688023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.721402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0387aa-8568-440a-ab37-556f011583e9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.780005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.780802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.781164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.781508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.795187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:39.801291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:39.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:39.803157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 327/681] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:39.809432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.818848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47558-d163-43c0-a2bf-c6c642011c8c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.860502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.870849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.872343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:39.872620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:39.872894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:39.885117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:39.886576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:39.904083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:39.905075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:39.905977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:39.905977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:39.905977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:39.905977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:39.906199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 355/682] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:39.914579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:39.956087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348791b-6b60-42bb-aaf2-edf0f1dd0cc3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:39.987573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:39.998418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:39.999479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.000291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.001004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.002983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:40.003701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.005933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 328/683] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:40.022701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:40.052100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7cf6-41f9-4bfe-8dce-9c0bc40d2b33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.090674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.091217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.091556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.091768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.092458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:40.092761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.094281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.107145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 356/684] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:40.112581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:40.148748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef41d-ca15-410c-bf11-a444abae9c1f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.157523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:40.194372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.195291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.195711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.196124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.210339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.212245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:40.230409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:40.231550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:40.232515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:40.232515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:40.232515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:40.232515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:40.234533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 329/685] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:40.241269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:40.274419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c168d9-6250-4e7e-b4c2-126dab55be9c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.328227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:40.343231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.343786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.344066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.344341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.345037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.346810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.388800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 357/686] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:43:40 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:43:40.418440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7b140-5d69-4b09-94ff-5870f57ce834 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.455838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.456463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.456736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.457022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.457720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:40.458016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.459476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.475604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 330/687] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:40.481847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:40.587844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:40.600141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd772-6d33-4bb4-ad7c-fd5afd1f8823 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.646045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.646711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.646994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.647271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.662260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.663730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:40.687897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:40.688896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:40.689889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 358/688] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:40.694937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:40.816344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856d97-a1e1-4328-a991-8086cb9481ea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:40.818764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:40.857186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:40.857731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:40.858008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:40.858280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:40.859124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:40.859434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:40.860862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:40.882654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 331/689] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:40.889104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.000778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e054-c0bd-4cb6-af0c-f47bcdd52ea8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:41.036925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:41.037600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.037880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.038151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.066005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:41.116684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:41.118796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:41.226627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 359/690] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:41.232718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.354629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23536a-a008-4ea7-aca1-753c6561d5ae None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:41.401896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:41.402462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.402745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.403022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.418428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:41.419872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8109c5e0-b7f9-4d2f-a220-a12bbbb541a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:41.438515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:41.440619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:41.442898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:41.442898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:41.442898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:41.442898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:41.442898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 332/691] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:41.449013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.505621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:41.553257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580fbe-2d26-420f-ae54-f4f385467eb5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:41.569480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3f36-76c8-419a-8a71-7b69dea37270 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.569782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3f36-76c8-419a-8a71-7b69dea37270 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.570022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3f36-76c8-419a-8a71-7b69dea37270 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.571563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 333/692] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:41.576584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719648-dacf-4c18-8890-d740aaded19a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.576866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719648-dacf-4c18-8890-d740aaded19a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.577166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719648-dacf-4c18-8890-d740aaded19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.609722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-99719648-dacf-4c18-8890-d740aaded19a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:41.610924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-99719648-dacf-4c18-8890-d740aaded19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:41.618983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848721-e399-423f-9b11-9479cade856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:41.619816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848721-e399-423f-9b11-9479cade856e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.620100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848721-e399-423f-9b11-9479cade856e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.620377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848721-e399-423f-9b11-9479cade856e None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.624250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848721-e399-423f-9b11-9479cade856e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:41.624617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848721-e399-423f-9b11-9479cade856e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:41.626022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848721-e399-423f-9b11-9479cade856e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:41.637072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:41.656061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 360/693] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:41.661572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848721-e399-423f-9b11-9479cade856e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.731997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 334/694] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:41.771990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848721-e399-423f-9b11-9479cade856e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:41.773356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99719648-dacf-4c18-8890-d740aaded19a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.790527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:41.811542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:41.812302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.812589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.812868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.820702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:41.822806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:41.836823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:41.839017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:41.841583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 361/695] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:41.849095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:41.918931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99719648-dacf-4c18-8890-d740aaded19a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:41.990090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:41.990744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:41.991021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:41.991291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:41.991924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:41.993934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:42.010424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:42.012763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:42.014842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 335/696] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 06:43:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:42.019943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.048190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea195e-3c52-44c8-b7a9-4d0a46946459 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.127616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.128269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.128553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.128828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.129628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:42.129943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.131405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0375-78e8-4985-948b-3c3ee7aaddc9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.155077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 362/697] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:42.161655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284357-1cc0-4b46-8238-ad0bc4ca22ac None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.161990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284357-1cc0-4b46-8238-ad0bc4ca22ac None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.162207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284357-1cc0-4b46-8238-ad0bc4ca22ac None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.164026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 363/698] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:42.164919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42284357-1cc0-4b46-8238-ad0bc4ca22ac None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.177853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.209693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.277811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d818a2-3a84-4052-95cf-bc755a8a51e1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.316021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.316661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.316946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.317247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.317936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:42.318238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.319638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b482a-0ea5-4ae1-8784-67addf1a0c19 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.325113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 336/699] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:42.326365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.326647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.326925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.345914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:42.347239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:42.409464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42284357-1cc0-4b46-8238-ad0bc4ca22ac None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.417786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 337/700] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:42.418453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.420811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.458094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.458633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.458906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.459173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.459971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=df74ba7216d64aa081a8ce2fbccb7b3a) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:42.460282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.461784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44274d8b-a59b-4802-88b0-927243e47924 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.473696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 364/701] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/role_assignments?user.id=df74ba7216d64aa081a8ce2fbccb7b3a&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:42.473696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245cfa1-31d0-4867-bcbe-babff7c5c525 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.473696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245cfa1-31d0-4867-bcbe-babff7c5c525 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.473696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245cfa1-31d0-4867-bcbe-babff7c5c525 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.479250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 365/702] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:42.479250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245cfa1-31d0-4867-bcbe-babff7c5c525 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.555302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202430e-b0ae-4630-9e94-fd9aadcda5bf None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.591865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.598149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245cfa1-31d0-4867-bcbe-babff7c5c525 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.603267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.604042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.604428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.604804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.605629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:42.606037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.607535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d476056-0d99-4435-b1e5-80694b805d2f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.617152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 338/703] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:42.619595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.620068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.620491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.653984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:42.655451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:42.661188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.661997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.662432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.662832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] PATH_INFO: `/v3/services/network` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.663606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.666161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:42.692094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:42.693200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:42.694038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 366/704] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:42.703349 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.744523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.755189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 339/705] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:42.781161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.854238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1252-9e7a-45b3-be1b-54fc867e4d1e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.896538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.897518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.898462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.898932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:42.900754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:42.901507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:42.903450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:42.910411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 367/706] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:42.916416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:42.922065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebb88c-3a79-45f6-93d3-68609b44902f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:42.963554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:42.985911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:42.986571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:42.986852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:42.987128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.012457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:43.017553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:43.018462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:43.019303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 340/707] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:43.026154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.093711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34428-5c88-41a2-a1bb-07cfdff601c3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.116915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:43.129119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.129753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.130036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.130312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.130991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:43.131295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.132656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb547f67-7dcb-44cc-b024-646b3f1c05f8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.139683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 368/708] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:43.145342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81714-f786-4bfb-9093-253a8a42e170 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.145629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81714-f786-4bfb-9093-253a8a42e170 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.145907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81714-f786-4bfb-9093-253a8a42e170 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.147556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 369/709] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:43.153861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.154146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.154427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.179576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c11a5-b4f8-4029-b745-5126b4caa144 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.206181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:43.207823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:43.225007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.225007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.225007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.225007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.225468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:43.225468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.226449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.237533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 341/710] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:43.242678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.315545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 370/711] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 06:43:43.346211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.377397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:43.379798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a95b-ddfc-4150-982a-f0a08beec832 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.403443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:43.423710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.424358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.424638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.424912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.440854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.442533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:43.468471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:43.469521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:43.470437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:43.470437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:43.470437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:43.470437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:43.473606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 342/712] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:43.475731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.498546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583e91-f7ed-4c09-b015-d24ee38b663b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.561619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.562326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.562612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.562882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.580190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:43.597444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:43.598418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:43.600441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 371/713] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:43.605268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.632418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2f92-6b9a-4685-84c1-71637b899cc5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.668623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.669660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.670161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.670657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.671573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:43.672097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.673952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.687389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 343/714] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:43.692879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.731143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:43.812504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:43.827616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3e88e-fc97-4e60-8cbc-90896e9f560a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.843356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c9fec-254d-4d6f-81ab-c2377017f0c7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:43.865328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.866344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.866866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.867363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.875583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.877375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:43.890319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:43.891376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:43.892340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:43.896422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 344/715] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:43.902297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:43.905680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:43.908592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:43.909194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:43.909682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:43.912296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:43.914940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:43.916558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:43.934275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 372/716] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:43.938365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.041520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427a66-776a-472d-91a3-d2a242fdef8e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.045313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:44.078435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.079263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.079689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.080077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.081073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:44.081494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.083052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.101870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 345/717] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:44.109355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.178183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f214f-f754-4d06-84c7-5554ba5b28cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.235609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.236246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.236522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.236792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.257923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.259446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.267070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:44.285524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:44.286531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:44.287603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:44.287603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:44.287603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:44.287603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:44.287603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 373/718] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:44.294171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765a38-014d-48a1-ba27-28adb6d4ea13 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.296325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.354906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.355625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.356005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.356378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.376280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:44.429985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.431791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.506845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24278-5932-43d3-b447-8c59aa7524ce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.573238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 346/719] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:44.577082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.579846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.580483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.580756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.581047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.581741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:44.582039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.591150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.616694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 374/720] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:44.622114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.668234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:44.731474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:44.761072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d118f-ba49-403e-adc3-d33b3a2ae106 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.803828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403a6cf-c2f9-4a91-834c-9847de53c214 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:44.817576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.818225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.818506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.818775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.831944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.833625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:44.851079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:44.852001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:44.854665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:44.854665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:44.854665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:44.854665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:44.860970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 347/721] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:44.861873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:44.878045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397675f-de85-4713-90df-86f767e87769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:44.878633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397675f-de85-4713-90df-86f767e87769 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:44.878964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397675f-de85-4713-90df-86f767e87769 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:44.879247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397675f-de85-4713-90df-86f767e87769 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:44.891999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397675f-de85-4713-90df-86f767e87769 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:44.893479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397675f-de85-4713-90df-86f767e87769 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b397675f-de85-4713-90df-86f767e87769 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:44.912449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:44.913489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:44.916680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 375/722] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:44.920715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397675f-de85-4713-90df-86f767e87769 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.030743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.033863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e63c41-2cf8-4abb-9a7c-ba23f184a204 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.071511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.072409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.072768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.073125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.073922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:45.074331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.075804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77be337-37f7-4b4f-961b-30d16ab9a196 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.087034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397675f-de85-4713-90df-86f767e87769 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.089642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 348/723] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:45.091438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1838e-9a6c-4d95-b0d4-9d593d658957 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.091841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1838e-9a6c-4d95-b0d4-9d593d658957 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.092219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1838e-9a6c-4d95-b0d4-9d593d658957 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.097796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 349/724] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:45.097796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1838e-9a6c-4d95-b0d4-9d593d658957 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.113631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.132456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.133125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.133512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.133791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.134766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:45.135079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.136509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4f45-4ff2-4b8f-95d0-80d90d14aa1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.156745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 376/725] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:45.158078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffd20-8904-4a74-a20e-50a173107f8a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.158420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffd20-8904-4a74-a20e-50a173107f8a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.158698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffd20-8904-4a74-a20e-50a173107f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.176272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-528ffd20-8904-4a74-a20e-50a173107f8a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:45.177480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-528ffd20-8904-4a74-a20e-50a173107f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:45.212540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1838e-9a6c-4d95-b0d4-9d593d658957 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 377/726] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df0c62-4030-4a1e-bd7d-c87abab0ea9a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df0c62-4030-4a1e-bd7d-c87abab0ea9a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df0c62-4030-4a1e-bd7d-c87abab0ea9a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 378/727] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:45.253012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df0c62-4030-4a1e-bd7d-c87abab0ea9a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.264373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.265135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.265901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.266184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.276344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.277953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-db9a902f-9e28-4cf7-9867-d7dad2f2ebf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:45.290716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:45.291601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:45.292496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 350/728] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:45.293494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.293494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.294491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.313234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:45.314579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:45.330195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.368362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df0c62-4030-4a1e-bd7d-c87abab0ea9a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.371795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.397103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 351/729] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:45.397103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.418357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.419014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.419283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.419532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.489803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.491779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.500927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2298ca-d9d8-4b9c-85a4-5436f1346f27 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.537698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.538343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.538621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.538894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.550490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:45.556472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:45.557759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:45.558639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 352/730] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:45.559343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.571971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.599993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 379/731] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 06:43:45.601039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.609683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.660812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbd72-2cad-480c-83bd-47907c223d53 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.695424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.696080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.696349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.699254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.699254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:45.699254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.699254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.710341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4c4c-22b8-47fa-9c46-573800e925c2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.710468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 353/732] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:45.711173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.749907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.750519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.750794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.751064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.751737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.753109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d37393-4eec-4a26-b993-6c721d5d7cb6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.768601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 380/733] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:43:45 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:45.769827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451e6f-ba96-4f13-9f21-871c1e19a3d0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.770114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451e6f-ba96-4f13-9f21-871c1e19a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.770387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451e6f-ba96-4f13-9f21-871c1e19a3d0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.771600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 381/734] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:45.772293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26451e6f-ba96-4f13-9f21-871c1e19a3d0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.795206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.834908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987e29-ccc3-4d9c-a8c6-08ee9d02d3d9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.854123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:45.883237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.884948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.885463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.885941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.886855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:45.887162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.888562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.902933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 354/735] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:45.902933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:45.905096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26451e6f-ba96-4f13-9f21-871c1e19a3d0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:45.944774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:45.945430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.946669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.946669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.957967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:45.959635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-84502f4f-3131-4341-82cf-36fe677df99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:45.975718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:45.976686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:45.977703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:45.977703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:45.977703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:45.977703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:45.977703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 382/736] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:45.978711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:45.978990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:45.979263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:45.997553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:45.998734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:46.025725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a1a9-d9d5-4101-8a2d-288470e01747 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.058865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.067483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.068096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.068370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.068637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.069454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:46.069758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.071780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.077324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 383/737] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 06:43:46.085350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 355/738] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:45 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:46.085475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.085553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.149009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.212180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b6628-e205-4a9e-93e3-87e53f0960e6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70d4ca-ad00-4f03-bb42-40561b62cde5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.255408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.256023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.256380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.256576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.257309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:46.257616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.259118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.272737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 356/739] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:46.273697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.278819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.279582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.279798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.280105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.292879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.294811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:46.314477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:46.315608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:46.316848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:46.316848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:46.316848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:46.316848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:46.320776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 384/740] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:46.321784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.335522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.397141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f3a4-93a3-49c6-8c6e-78f330de74d9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.439163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.439893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.440247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.440590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.441438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.442915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.443805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.449998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca8b2-f3cf-42bb-b79c-908975f691e5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.467024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 357/741] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:43:46 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:46.468042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.554318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.555045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.555527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.555941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.571862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.573602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:46.597616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:46.598574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:46.599459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:46.600134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 385/742] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:46.609280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.693188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7905a9-c506-45df-97a0-cdfa3d349d0d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.714736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.743283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc679cd-94fb-438d-88fc-f2eb6e67a7fd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.746468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.747142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.747418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.747692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.748381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:46.748681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.750084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.766077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 358/743] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:46.772363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.783955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.784684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.784967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.785259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.786158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:46.786466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.788709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.802437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 386/744] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:46.810040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.828496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:46.915875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414bda-1b7c-476d-8e57-c21d7a3f6e6b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:46.956768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:46.957456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:46.957729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:46.958707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:46.968273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:46.969773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:46.984855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:46.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:46.989328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 359/745] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:46.997067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:46.998182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048488-006d-44e0-afe7-881cd4b33bad None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:47.037604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:47.099984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:47.100612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:47.100892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:47.101192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:47.102501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=ad7f47c74bc54f67bde9d523cd0b4936) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:47.102820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:47.104242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:47.114298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241fcb5-1d95-4a59-a966-9fb0aac6c02e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:47.118245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 387/746] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/role_assignments?user.id=ad7f47c74bc54f67bde9d523cd0b4936&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:47.152479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:47.153135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:47.153478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:47.153754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:47.154547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:47.154849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:47.156269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:47.176943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 360/747] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:47.182714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:47.302176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:47.335072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef61e-99f5-4978-9be5-326cd46629cb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:47.375237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:47.375866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:47.376207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:47.376495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:47.450260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:47.451691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:47.551126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:47.582150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 388/748] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:43:47.587994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:47.693041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb01c1c-8de9-454d-b2c9-9b303519f0e3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:47.694683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:47.730680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:47.731321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:47.731593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:47.731861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:47.743478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:47.745006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:47.761517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:47.763631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:47.765787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:47.765787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:47.765787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:47.765787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:47.765787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 361/749] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:47.768564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:47.886631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad50ad-358e-46b8-8e86-d8ca243151fd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:47.933504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:47.934130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:47.934408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:47.934676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:47.935362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:47.935764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:47.937193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:47.952717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 389/750] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:47.958323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.076972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442d2c-01b4-437b-821e-2d3b0f1bb83a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:48.112524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:48.113197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.113533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.113809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.121339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:48.122767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-94d0a874-f9d4-4895-95bd-2413824d18b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:48.134830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:48.136891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:48.138101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 362/751] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:48.141570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.174940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479f1d-690c-4225-852a-19d9795e8d14 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.175246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479f1d-690c-4225-852a-19d9795e8d14 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.175476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479f1d-690c-4225-852a-19d9795e8d14 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.176806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 363/752] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:48.190943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.191223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.191486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.195319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:48.206769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:48.229977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:48.231169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:48.268039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6c808-a7af-4d1f-b290-e5deb1d5b47f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:48.304617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:48.305944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.306126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.306431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.307941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:48.308247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:48.309877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:48.324387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 390/753] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:48.332761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.365136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 364/754] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:48.394508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.486026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:48.497193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68d2c-0a9d-4b76-8375-75153845ad96 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:48.534304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:48.535030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.535212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.535479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.536402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=df74ba7216d64aa081a8ce2fbccb7b3a) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:48.536615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:48.538118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff605503-335b-400d-8c68-c26024c67720 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:48.543698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42c87-e8b5-4b2c-998a-c57d06174ab8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:48.544811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 391/755] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/role_assignments?user.id=df74ba7216d64aa081a8ce2fbccb7b3a&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:48.549876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e67a8-269e-4d86-a961-0e4125530bf6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.549876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e67a8-269e-4d86-a961-0e4125530bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.549876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e67a8-269e-4d86-a961-0e4125530bf6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.549876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 392/756] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:48.553919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7704-0290-477d-a601-3c0159acecea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.554173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7704-0290-477d-a601-3c0159acecea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.554371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7704-0290-477d-a601-3c0159acecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.588803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-417b7704-0290-477d-a601-3c0159acecea None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:48.590308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-417b7704-0290-477d-a601-3c0159acecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:48.614571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:48.623593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:48.624251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.624531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.624805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.625468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:48.626850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:48.636923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:48.637869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:48.638712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 365/757] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:48.649501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.762776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 393/758] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:48.799649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7704-0290-477d-a601-3c0159acecea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.825205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e4ac-e8b5-4293-a715-9b9047b03a7d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:48.931360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:48.931916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:48.932188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:48.932455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:48.933171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:48.933471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:48.934844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:48.949385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:48.954040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 366/759] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:48.959929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:48.960407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7704-0290-477d-a601-3c0159acecea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.023077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.024722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.025228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.025741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.050442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:49.060711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:49.061759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:49.062592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:49.067316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 394/760] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:49.074314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.104106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:49.191712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb786d84-bdf3-4db9-8f60-a963e8879cf7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.266623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.267665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.268139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.268604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.269559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:49.270075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.272851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.286467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 367/761] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:49.288855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.290593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf7ff-951c-4036-9488-7b4e151d077a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.365142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.366575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.368054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.368675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.370226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:49.373079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.374950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5e0f3-303d-4d20-ab90-110154771803 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.400717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 395/762] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:49.402428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec10e2-8d54-4975-b1b5-79526c9be232 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.402929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec10e2-8d54-4975-b1b5-79526c9be232 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.403454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec10e2-8d54-4975-b1b5-79526c9be232 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.406347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 396/763] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:49.407248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec10e2-8d54-4975-b1b5-79526c9be232 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.442796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:49.509964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b615b0-e7a0-4526-8aec-51c2aa3f187e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.536752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:49.549775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.550720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.550851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.551054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.551817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] RBAC: Adding query filter params (interface=public, service_id=bdfe7941fece443b839603ac75bd5ea5, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:49.552128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.553577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8f4c-1d37-46f4-8b6c-5fb61371c228 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.563046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 368/764] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/endpoints?service_id=bdfe7941fece443b839603ac75bd5ea5&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:49.564347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717eeb-0fdd-4b34-a7c1-e64ea2634127 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.564638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717eeb-0fdd-4b34-a7c1-e64ea2634127 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.564930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717eeb-0fdd-4b34-a7c1-e64ea2634127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.566290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec10e2-8d54-4975-b1b5-79526c9be232 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.584865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f5717eeb-0fdd-4b34-a7c1-e64ea2634127 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:49.586012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5717eeb-0fdd-4b34-a7c1-e64ea2634127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:49.603836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.605097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.605389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.605659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.616233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.617859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:49.632184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:49.633300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:49.634500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:49.634500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:49.634500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:49.634500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:49.638076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 397/765] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:49.638875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.661553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 369/766] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:49.663017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a450-3c5a-485b-bb52-cde7e7146769 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.663463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a450-3c5a-485b-bb52-cde7e7146769 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.663920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a450-3c5a-485b-bb52-cde7e7146769 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.669577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 370/767] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:49.669577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0a450-3c5a-485b-bb52-cde7e7146769 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.727859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:49.764228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e981033-9ca1-4cab-ae7a-42d5b73e328f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.783733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0a450-3c5a-485b-bb52-cde7e7146769 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:49.801321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.802036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.802161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:49.802386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.802904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.803469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.805141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5e06b-012a-4bbe-87a6-4a085d1f4e95 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.810468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 398/768] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:49.811638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.811923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.812182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.830809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:49.832104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:49.832658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:49.833143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:49.833415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:49.834591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:49.834709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:49.835259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:49.837733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:49.856429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 371/769] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:49.857942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.930579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 399/770] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:49.931814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:49.997504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f2cb-206d-4cbf-b370-07a703359feb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.006079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.040895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.041583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.041867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.042140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] PATH_INFO: `/v3/services/network` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.042780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.044158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.052627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbbdbf-7ec7-483a-a155-15090c2bf4a0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:50.053899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:50.054973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:50.055990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 372/771] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:50.056779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.098468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.099117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.099397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.099714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.107344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.107486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.109035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:50.122841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:50.123830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:50.124768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 400/772] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:50.125982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.179560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ed0a2-0274-4d03-8c90-58c1f71216bd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.221872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.221872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.221872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.221872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.235470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:50.244596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:50.246453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 373/773] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:50.247967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.257005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2d8eb-2320-4057-a87f-0514eb3a363c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.278714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.297836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.298590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.298938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.299282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.300039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.300417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.302338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.313048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 401/774] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.314294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.378096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce04f-ccea-44fb-89b5-4fccd7fdfa47 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.391091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.422013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.422919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.423351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.423828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.424612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b0aa6-5bc7-4a9a-9128-0c1ad32ea632 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.425297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.425752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.427508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.447871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 374/775] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.448940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.463202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.463831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.464218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.464379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.465391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.465697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.467150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.476166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 402/776] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.477474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.528068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.562773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3381-8f9d-4e96-ae6b-a3f0f35a2758 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.585958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2af22-ad60-4973-971f-dd7676f30d1d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.603630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.604692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.605223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.605808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.606718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] RBAC: Adding query filter params (type=network) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.607228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.608893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.614756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 375/777] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.615906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.623485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.624194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.624527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.624807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.637500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.639132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.645606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:50.659069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:50.660004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:50.660905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:50.660905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:50.660905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:50.660905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:50.660905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 403/778] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:50.661658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.741896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c42c6-3d09-4ae0-8827-f79727a7589b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.767291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.771671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366351-3ab2-4b9c-a46b-1e5ab5062d45 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.780878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.781835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.782309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.782857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.794285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.795998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.808706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.809377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.809669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.809981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.810741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] RBAC: Adding query filter params (interface=public, service_id=947b2b7b9c0e46b38e1ac9d110abc6fc, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.811053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.812420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:50.813382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:50.814245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:50.815125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:50.815125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:50.815125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:50.815125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:50.817069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 376/779] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:50.818055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.821464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 404/780] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/endpoints?service_id=947b2b7b9c0e46b38e1ac9d110abc6fc&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.823717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.906429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:50.931634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254916-487d-4f3e-9232-c700b106ca21 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.933084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758f84b-ba02-4be1-9613-67625809c1cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:50.969062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.969416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:50.969677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.969954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.970053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.970225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.970321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.970544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.970905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.971205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.971297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:50.971504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:50.972547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.972838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592e38b-9dd5-4d45-ad37-657b8bc67950 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:50.993007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 405/781] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:50.993222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 377/782] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:50.993320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:50.993420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8448-49fd-49b3-90d4-63b344d4d158 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:50.993420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8448-49fd-49b3-90d4-63b344d4d158 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:50.993420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8448-49fd-49b3-90d4-63b344d4d158 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:50.993420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 378/783] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:50.995319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8448-49fd-49b3-90d4-63b344d4d158 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.018920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.108270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8448-49fd-49b3-90d4-63b344d4d158 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.109045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cdf61-3f0d-4233-b0b1-d4baa443fcf4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.147018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.147659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.147938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.148212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.149288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.149910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.150296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.150584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.151254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.151703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.152610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6eff2-4d91-4f87-8ae7-31463e2f2fa1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.157309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.158045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 406/784] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:51.159014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.159292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.159563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.167488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.178927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:51.181062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:51.185867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:51.186893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 379/785] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:43:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:51.193498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.283760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 407/786] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:51.285650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.310995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.314693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f722d-2809-4e12-af12-ce9f5122503d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.366404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.368032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.368332 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.368734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.377961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.380243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:51.395194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:51.396131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:51.397052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 380/787] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:51.398025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.409753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453825e-878e-42f6-aacd-f5ebe8aebe96 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.444524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.445947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.446510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.446887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.447855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:51.448265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.449891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.468924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.470517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 408/788] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:51.471622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.521973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2784c-3228-45df-837d-3014f5b1c4b8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.558900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.562036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.563612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.564033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.564864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.579755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:51.588106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:51.589137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:51.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:51.590955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970245-c976-4a75-91b6-dc1468dad90d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.593798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 381/789] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:51.594438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.629280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.629887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.630217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.630496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.631297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:51.631635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.633743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.662248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 409/790] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:51.663157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.734672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98894-6af9-41f5-8711-d9ca946ed0f3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.755328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.779149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.780303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.781067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.781547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.796451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.797508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486b255-90e8-40e9-9b7c-3038301c3d6e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.798483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:51.817614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:51.818538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:51.819419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:51.819419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:51.819419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:51.819419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:51.823888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 382/791] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:51.824713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.841901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.842843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.843345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.843855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.844864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:51.845389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.846939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.848543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:51.857484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 410/792] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:51.858636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:51.932880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1bbb-b28f-40e1-84eb-304b09ea7a45 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.969093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:51.969722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:51.970001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:51.970284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:51.972153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0ae39-5304-4517-be4e-97d5b8543494 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:51.972268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=2245988d98b1408bba171ce6979796b0, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:51.973805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:51.993205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 383/793] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:51 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:51.994218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.012076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.013156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.013722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.014193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.015129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:52.015654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.017076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdf4d7-8a76-42f7-bca3-d61e3ad13a86 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.031234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 411/794] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:52.032572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259539a2-b82d-4843-bf89-23036b3530ad None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.032855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259539a2-b82d-4843-bf89-23036b3530ad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.033365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259539a2-b82d-4843-bf89-23036b3530ad None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.034963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 412/795] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:52.037707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259539a2-b82d-4843-bf89-23036b3530ad None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.043731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.111538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.146562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80d23-103d-42dd-a158-e5e46d601895 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.163750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259539a2-b82d-4843-bf89-23036b3530ad None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.193995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.194391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.194670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.194944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.208082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.209738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.210375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.211087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.211506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.211845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.221129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.222578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-14446e80-f904-4e43-9828-af6c189376f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:52.226111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:52.227546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:52.228998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:52.228998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:52.228998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:52.228998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:52.228998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 384/796] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:52.229610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.229731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.229964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:52.235894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:52.236908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:52.238291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:52.238861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 413/797] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:52.239680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.250769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:52.252123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:52.338774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 385/798] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:52.340385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.366910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.380508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ac3b9-447d-4fe3-90cd-16b9e14733f9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.403604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.429130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.429858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.430511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.430794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.431481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:52.431782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.434333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.455332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 414/799] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:52.455332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.469029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbc44-e5a1-4b96-96b8-28923654644b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.506721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.507383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.507661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.508081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.509030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:52.509341 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.510883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.524531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 386/800] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:52.525397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.589715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a0a9-17ef-45f4-8f07-55d85d428685 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.603704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.627220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.628299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.628720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.629169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.629960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.631667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.637283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cf77-8c23-43a9-a554-216eef549239 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:52.641556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:52.642667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 06:43:52.643562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:52.651105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 415/801] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:52.652205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.673794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.674506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.674833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.675104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.687459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.689090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.698675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:52.703040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:52.704162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:52.705166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:52.708876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 387/802] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:52.709881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.767965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884ef5-c497-42a2-8255-8b5dabc1fac1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.806233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.807054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.807335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.807608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/ad7f47c74bc54f67bde9d523cd0b4936/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.819360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e710b2-2902-46e5-81f1-3bf7b5079c2a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:52.823407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=ad7f47c74bc54f67bde9d523cd0b4936, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.824841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.841904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 416/803] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:52 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/ad7f47c74bc54f67bde9d523cd0b4936/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:43:52.842745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:52.855402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:52.862184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:52.863212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:52.863696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:52.864176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:52.865275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:52.865920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:52.867716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:52.873912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 388/804] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:52.882291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.014414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.033261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f4cfc-6a94-4b76-8421-ad4ff1143b98 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.061028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1d1d-b688-466f-8608-1d1c20380bdf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.089459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.090626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.090901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.091196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.092198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:53.092503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.094743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.102170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.102907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.103182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.103453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.104128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:53.104428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.106747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.118457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 417/806] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:53.118663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 389/806] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 06:43:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:53.126883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.127440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.193843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.257310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192310-eb5a-4ef5-921c-97b837fcfd8f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.280136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154936-44af-4f41-bd57-06145e2df992 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.314639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.316373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.317061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.318493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.337573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.338547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.339043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.339507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.340695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.342638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.347587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.349290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-16fc8a6f-81b7-4e6e-8a11-41d3f3b5b617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:53.375348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:53.376293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:53.377230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:53.377230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:53.377230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:53.377230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:53.386312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 418/808] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:43:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:43:53.386661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 390/808] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:53.388416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.392368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.399258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec9dd-3c17-4471-a251-09b0790a3d1a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.399894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec9dd-3c17-4471-a251-09b0790a3d1a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.400365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec9dd-3c17-4471-a251-09b0790a3d1a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.402472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 391/809] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:53.422660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.423306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.423811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.447987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:53.453016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:53.540166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 392/810] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:53.565991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.588888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1ee8-a439-4463-87e8-c6d6a0d6314e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.616556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.627995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.628628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.628912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.629223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.629938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:53.630413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.631614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.644289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 419/811] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:53.651304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.696465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de298d-23e9-4931-85b2-38bae5d37aec None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.729434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.738517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.739165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.739439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.739712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] PATH_INFO: `/v3/services/network` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.740330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.741720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:53.756511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:53.758345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 06:43:53.759330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:53.762155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 393/812] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:53.767974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.781594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13a9a0-9118-409d-a1f1-dbddbc4bc061 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.818043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.818796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.819084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.819358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.826921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.828380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:53.841124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:53.842198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:53.843197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:53.845412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 420/813] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:53.848630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.885046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:53.891157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c7d70-0e57-4353-9751-c5c07ad83ffa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:53.927733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:53.928433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:53.928625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:53.928897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:53.929615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:53.929998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:53.931509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:53.937079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 394/814] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:53.942145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:53.973775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602c03-52d5-409c-8b57-498a6dc10cbd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.001357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:54.011414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.012299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.012922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.013394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.014889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:54.015384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:54.017630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:54.038721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 421/815] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:54.040148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:54.075457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a1f0-5430-4489-9152-643617de4fc8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.143543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.144153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.144632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.144913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.145724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] RBAC: Adding query filter params (type=network) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:54.146031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:54.147550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:54.155631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c43c4-d61d-4e40-9f06-7ee7754cb7af None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.163426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 395/816] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:43:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:54.169399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:54.204823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.206715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.207297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.208333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/df74ba7216d64aa081a8ce2fbccb7b3a/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.213451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=df74ba7216d64aa081a8ce2fbccb7b3a, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:54.215699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dc5dd-e837-42f7-a544-bf5ccb433b62 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:54.226897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:54.240202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 422/817] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:43:54 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/df74ba7216d64aa081a8ce2fbccb7b3a/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:43:54.313646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c96f1-a0bd-4e9b-b8d3-3096ff7ba096 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.367159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.368668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.369256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.369729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.370734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:54.372531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:54.392872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154995a-ee99-4d5d-96a8-f82a954be3b3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.393342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154995a-ee99-4d5d-96a8-f82a954be3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.393731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154995a-ee99-4d5d-96a8-f82a954be3b3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.395477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 423/818] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:54.401358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.402022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.402494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.410742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 396/819] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:43:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:43:54.441619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:54.448135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:54.498360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:54.541784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 424/820] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:54.565605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:54.691238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:54.717257 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f92d-eb9e-41d0-8a33-5476c69dd319 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.771690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.772770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.773310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.773833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.786138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:54.792033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:54.793005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:54.793899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:54.797870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 397/821] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:54.804243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:54.945902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ebe1b-76bc-46b7-8d71-1110b6edc283 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:54.992024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:54.993629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:54.994136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:54.995235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:54.996180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:54.996713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:54.998318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:55.012319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 425/822] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:55.015378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.138636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6f3c-a0a3-4ff3-a244-3f036a4d99a7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.181915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:55.182572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.182858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.183131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.195741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:55.197549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:55.200326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:55.216691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:55.217670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:55.218562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:55.218562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:55.218562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:55.218562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:55.218562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 398/823] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:55.225847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.264064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:55.345951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5c7f9-040f-48e1-b3dc-2ba556a00939 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.386101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:55.387542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.388323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.388898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.389856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:55.390367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:55.391929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881652-0253-4dde-b56c-c01c3229a882 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:55.406074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 426/824] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:55.411985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.532266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7bd9c-da79-48cb-8ec7-843bba4e52fe None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.532758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7bd9c-da79-48cb-8ec7-843bba4e52fe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.533216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7bd9c-da79-48cb-8ec7-843bba4e52fe None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.534930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 427/825] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:55.539459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfecee-0269-4f8c-9369-4160acca073c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.540970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.541432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.541847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.560949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:55.562434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:55.574098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:55.574886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.575286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.575667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.583665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:55.585268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:55.597870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:55.598973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:43:55.600079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:55.607135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 399/826] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:55.608335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.661258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 428/827] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:43:55.678601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:55.680332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.717424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:55.743951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2999-09bf-4c55-9860-3df928245b6e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.785632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:55.786481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.786902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.787409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.788345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:55.788797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:55.791256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:55.814964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c39cca-e626-4a53-85e2-0b2d7126710f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.815869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 400/828] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:55.816912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.849727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:55.850555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:55.850945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:55.851294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:55.862272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:55.867328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:55.868443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:43:55.869460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:55.876303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 429/829] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:55.877708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:55.944710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3f4f-c648-4041-83ad-28ca9b02253e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:55.965207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:55.989479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.003430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.004654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.005164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.005913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.009830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9424eea-31a1-4df7-985a-2931f6d98ced None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.046161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.047171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.047640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.048129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.049464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:56.049574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.050972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.064171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 430/830] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:56.067482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.098320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.099982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b029cbd-2334-44db-9b25-ebcca377f72d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.180083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885022-5f24-463b-9678-e5e8f070378b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.206509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 401/831] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:43:56.212585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3e08-e040-4ca9-ab5e-104e53a954a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.212872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3e08-e040-4ca9-ab5e-104e53a954a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.213173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3e08-e040-4ca9-ab5e-104e53a954a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.214451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 402/832] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:56.215398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3e08-e040-4ca9-ab5e-104e53a954a3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.220260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.220914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.221236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.221509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.233422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.233664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.234864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.238082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-aa0238bd-a2d8-4916-9380-ea1a3d3aac1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:56.252687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:56.253661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:56.254568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:56.254568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:56.254568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:56.254568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:56.254568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 431/833] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:56.256423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.256423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.256423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.274105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:56.275540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:56.331205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3e08-e040-4ca9-ab5e-104e53a954a3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.346386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 432/834] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:56.347218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.381712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.382785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.383237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.383539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.393955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.395402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:56.410554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:56.411445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:56.412348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:56.412348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:56.412348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:56.412348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.412348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 403/835] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:56.414579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.464672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7d63-4336-40c0-9aa7-a4c10a1dd838 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.478306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.493867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.503749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.504446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.504907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.505266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.506130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:56.506499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.508077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.514550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c610-bf24-451c-9c0e-9b7164754ed6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.525853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 433/836] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:56.525853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.554296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.555464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.555745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.556023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.556649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.558085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:56.567114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:56.568103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.568936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 404/837] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:56.569758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.631139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f1b0-c962-442b-a77e-8d8e4f29c4a6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.664475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.665133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.665411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.665679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.666347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:56.666645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.667979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.680049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 434/838] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:56.680430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82d3b0-9a26-4178-826f-d582b3865d01 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.680856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.712314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.718741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.719384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.719661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.719943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.726200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.728663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.730202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8330d046-0667-45e7-bc00-45bdf7fa6f77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:56.741350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:56.742946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.743891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 405/839] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:56.744495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8622c-2ec1-4df2-aa5c-4db5ed98636c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.744768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8622c-2ec1-4df2-aa5c-4db5ed98636c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.745141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8622c-2ec1-4df2-aa5c-4db5ed98636c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.746290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 406/840] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:56.746962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8622c-2ec1-4df2-aa5c-4db5ed98636c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.784974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372144d9-0349-4fce-bd7e-3884885217f9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.818441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.819038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.819315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.819579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.820598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:56.820900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.822264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.826689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 435/841] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:56.827366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.848654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8622c-2ec1-4df2-aa5c-4db5ed98636c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.882302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.883404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.883681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.883951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.890523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.891959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f6d0f91c-5d93-44e8-9971-c81799d73db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:56.904772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:56.905730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:56.906629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 407/842] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:56.907411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.907697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.907969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.925173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:56.925359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66c38-17e8-4aca-b163-08d429ca108e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:56.926357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:56.935767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.959233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:56.959838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:56.960111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:56.960378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:56.962419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:56.962746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:56.964184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:56.974490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:56.981192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 436/843] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:56.981992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:56.999434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 408/844] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:43:57.000252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.083532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af5e6d-8254-470e-b1f1-f7e9eb5f067e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.111259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58dd57-f171-4582-9fcd-6def5c257c3a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.116367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.117531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.117821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.118089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.118746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:57.119051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.120451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.124702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 437/845] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:57.125499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.160347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.165627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.166252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.166528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.166797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.167555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:57.167858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.169335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.183700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 409/846] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:57.184664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.232017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.245867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde70f6-07ee-4831-bea4-1347db65c91f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.294906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.295140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0551-34f4-4f45-aab1-71c4c792f40b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.295543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.295826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.296099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.331510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.332158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.332440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.332719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.344529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:43:57.350239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:57.351221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:57.352215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 410/847] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:57.352906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.374240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.375683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.408469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.457256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.462058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed3984-e58f-4bdf-b209-7e31c9e11da2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.486073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 438/848] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:43:57.486895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.502176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.502796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.503079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.503353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.504135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:57.504443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.505896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.512781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 411/849] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:57.513450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.622353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f17a-c02c-4027-8edf-03d9716fa9df None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.656585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1d24f-426b-40e2-a842-e5ad4c25a921 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.667872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.682348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.683078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.683424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.683765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.685359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:57.685359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.686338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.699159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 439/850] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:57.704711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.716400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.717015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.717300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.717574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.732086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.733660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:57.753474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:57.754455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:57.755362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:57.755362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:57.755362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:57.755362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:57.755362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 412/851] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:57.763518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.784200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:57.832858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaec0f-d5c7-4487-b25d-8e2825b29e8d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.870354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab655-674d-4821-b931-977235885e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.871009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab655-674d-4821-b931-977235885e68 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.871291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab655-674d-4821-b931-977235885e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.871568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab655-674d-4821-b931-977235885e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.875601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99713-ccee-4f41-89d2-3c7a6bb90872 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:57.883856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab655-674d-4821-b931-977235885e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.885335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab655-674d-4821-b931-977235885e68 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-822ab655-674d-4821-b931-977235885e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:57.900427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:57.902540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:57.904625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:57.904625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:57.904625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:57.904625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:57.904625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 440/852] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:43:57.913002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab655-674d-4821-b931-977235885e68 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.913249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:57.913249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:57.913249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:57.913249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:57.913919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:57.913919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:57.915036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:57.932534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 413/853] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:57.933882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:57.958935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.015324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab655-674d-4821-b931-977235885e68 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.019874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.045772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a339b8-e211-42ad-b17b-e178da719421 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.050464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.051095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.051376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.051708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.052402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:58.052757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.054152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.072046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 441/854] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:58.072973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.084604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.085283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.085558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.086652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.094434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.095875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:58.108208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:58.110301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:58.112371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:58.121016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 414/855] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:58.121016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.178246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aea50-4eda-4f5f-8154-41fdb141cb66 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.185929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.214405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.215318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.215600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.215873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.223332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.224771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.229371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d32f5-5034-4c53-b36d-1ed49c35223b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:43:58.237899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:58.240030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 06:43:58.242352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:43:58.253005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 442/856] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:58.253005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.266991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.267635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.267970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.268245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.269014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:58.269325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.270899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.274510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.293775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 415/857] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:58.295115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.371237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4258cf-e567-4152-9183-6a020fa83192 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.415945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2fd88-9a47-48c3-94f5-06d06afcf958 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.417225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.417843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.418122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.418393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.419176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:58.419474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.420886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.438720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 443/858] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:58.445964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.456762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.457466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.457748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.458021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.458801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=ad7f47c74bc54f67bde9d523cd0b4936) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:58.459110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.460946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.467519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 416/859] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/role_assignments?user.id=ad7f47c74bc54f67bde9d523cd0b4936&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:58.477714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.562107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54822936-fa72-4703-b207-4040eaa42657 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.604477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.605149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.605427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.605698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.683143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.684688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.710240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.795112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 444/860] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:43:58.800779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:58.864534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:58.907838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1088f-8446-471a-bdd5-42050c14a137 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:58.943024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:58.943714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:58.944001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:58.944277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:58.955845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:58.957323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:43:58.973056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:58.975186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:58.977878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:43:58.977878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:43:58.977878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:43:58.977878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:58.977878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 417/861] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:58.980768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.082939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749294b8-ff0f-40cb-979c-025d4e97d386 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.108299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:59.120809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:59.121395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.121672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.121940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.122630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:59.122928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:59.124280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e37e-9835-49d7-995e-6df32d40e337 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:59.137458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 445/862] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:43:59.142729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.231522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08e69-91cf-460c-a4fb-073b0e313fe2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.231855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08e69-91cf-460c-a4fb-073b0e313fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.232055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08e69-91cf-460c-a4fb-073b0e313fe2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.233866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 446/863] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:43:59.238698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.238977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.239300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.253446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9bb86-c5da-470b-a230-efea6a4ef56f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.258659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:59.259908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:59.269014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:59.297603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:59.298249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.298533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.298803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.308091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:59.310516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:43:59.326187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:43:59.327683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:43:59.329009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 418/864] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:43:59.333839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.341379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 447/865] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:43:59.363856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.467423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32ca-1b16-41c4-8879-875033e4e2db None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.474398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4c3e9-495a-44a0-8b99-7c82a9e9fa03 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.491195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:59.512814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:59.513711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.513993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.514270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.515022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:59.515331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:59.516795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:59.518254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:59.519087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.519566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.520034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.520929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:59.522541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3f8f-aafc-4cc9-8fc2-6173525a9d5e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:59.530354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 419/866] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:59.536507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.542892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 448/867] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:43:59 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:43:59.581830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:59.655800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc7b0-562f-46a9-b23b-717acf5b1332 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.701145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828532-7898-4fef-aebb-a7ff0d1d7821 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.701870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828532-7898-4fef-aebb-a7ff0d1d7821 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.701870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828532-7898-4fef-aebb-a7ff0d1d7821 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.703033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 449/868] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:43:59.708301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.708586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.708862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.728137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:43:59.729001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:43:59.729278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:43:59.729751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:43:59.730023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:43:59.730811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=df74ba7216d64aa081a8ce2fbccb7b3a) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:43:59.730930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:43:59.731115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:43:59.732551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:43:59.742980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 420/869] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:43:59 2022] GET /identity/v3/role_assignments?user.id=df74ba7216d64aa081a8ce2fbccb7b3a&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:43:59.821482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 450/870] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:43:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:43:59.845446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:43:59.952635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:43:59.962939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a761-6d76-40bc-a4ac-15362cb8ae94 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:43:59.999474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:00.000035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:00.000316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:00.000586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:00.001236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:00.002605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:00.012647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:00.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:00.014503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 421/871] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 06:43:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:00.020117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:00.128444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5334d05-95c5-4f94-8a52-4fcb9a21d62c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:00.130823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:00.166537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:00.167171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:00.167450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:00.167724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:00.168399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:00.168703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:00.170094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882c80b-a127-4471-b7a3-f44ae2d7e41a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:00.175084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 451/872] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:00.180945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:00.288463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6421-d719-4919-9f7a-9f59a879cf38 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:00.325560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:00.326534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:00.327014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:00.327507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:00.328409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:00.328915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:00.330500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b8f1-0f2b-4501-90ff-c7254597c306 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:00.336326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 422/873] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:00.828079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e65-5db6-4ed3-8f6f-64fcb262b27c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:00.828384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e65-5db6-4ed3-8f6f-64fcb262b27c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:00.828621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e65-5db6-4ed3-8f6f-64fcb262b27c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:00.830398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 452/874] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:00.835783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:00.836340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:00.836844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:00.855894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:00.857457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:00.873520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:00.928735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 423/875] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:00.952226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22e65-5db6-4ed3-8f6f-64fcb262b27c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.057941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22e65-5db6-4ed3-8f6f-64fcb262b27c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.093197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.093846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.094125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.094395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.105309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:01.110258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:01.111206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:01.112052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 453/876] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:01.118058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.220330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa1e95-89a6-4825-b810-7514ae2a39d3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.255419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.255907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.256188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.256460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.257201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:01.258083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:01.259553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:01.268057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 424/877] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:01.273721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.305420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:01.379268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d43c30-cbe8-4b8d-b464-e1390ade81c6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.414775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.415422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.415703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.416018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.426731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:01.428178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:01.443991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:01.445026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:01.446140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:01.446140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:01.446140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:01.446140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:01.446140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 454/878] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:01.451297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.468031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:01.562244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075045-7ab2-4499-91cf-0455ac4e537b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.603687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.604313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.604595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.604871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.605593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:01.605899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:01.607262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc297a3e-290f-45d1-b7e9-464978a4465f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:01.619709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 425/879] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:01.625190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.728588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612893fa-d094-4291-8d21-dc4809ebfa88 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.728888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612893fa-d094-4291-8d21-dc4809ebfa88 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.729169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612893fa-d094-4291-8d21-dc4809ebfa88 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.731713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 426/880] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:01.735246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:01.736774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.737090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.737363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.747625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f84ca-2f9c-4944-bca5-456152f7e541 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.757819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:01.758963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:01.787511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.788705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.789299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.789802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.798360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:01.799825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:01.812668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:01.813655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:01.815222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 455/881] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:01.819669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.845206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 427/882] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:01.862440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:01.865093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:01.933791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1ad6-1031-4519-99f7-fffb9ea4978b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.971346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc667c-8782-4c6f-83c0-7444bfeab5bb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:01.973252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:01.974227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:01.974353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:01.974517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:01.975305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:01.975609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:01.977634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2f5eb-eb1e-4cca-ad4f-b3b84fc95653 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:01.988178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:01.999337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 456/883] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:02.000745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7972-90f4-4868-a1f9-5fc228acf522 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.001065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7972-90f4-4868-a1f9-5fc228acf522 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.001347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7972-90f4-4868-a1f9-5fc228acf522 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.005095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 457/884] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:02.007239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c7972-90f4-4868-a1f9-5fc228acf522 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.013238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.013882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.014155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.014421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.015042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.016429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-efb2076d-0f44-4784-a077-f591a4553d9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:02.025775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:02.026881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:02.027744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.031836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 428/885] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:02.033417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.033614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.033885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.052229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:02.053431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:02.116388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.120062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c7972-90f4-4868-a1f9-5fc228acf522 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.126015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 429/886] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:02.127040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.169644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.170261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.170538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.170811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.234520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41c24-961c-419c-af70-eb2e820f00c0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.235922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.239624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.242207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.270865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.271482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.271762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.272035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.272769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.273611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.274971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.279732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 430/887] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.280494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.347187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.359501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 458/888] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:02.359501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.391677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6cc1-e4bb-4f6c-88ba-29ca349e4998 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.427265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.427906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.428179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.428454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.429122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.430759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:02.441519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:02.442736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.443584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 431/889] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:02.444392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.466302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.471373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866f24-e897-4f0c-9601-ede8b4b431d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.506033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.506651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.506921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.507187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.507897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.508442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.509592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.514218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 459/890] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.514974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.546159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d393be-af87-416e-a2d0-5684cf092943 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.569369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.580298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.580943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.581252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.581526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.592639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.594108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-84616870-7175-4334-8089-b7f7f4deee5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:02.608515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:02.609651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:02.610533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:02.610533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:02.610533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:02.610533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:02.610533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 432/891] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:02.610824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9ce-1d94-4427-83de-f49c861b0582 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.611091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9ce-1d94-4427-83de-f49c861b0582 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.611325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9ce-1d94-4427-83de-f49c861b0582 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.612550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 433/892] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:02.613254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb9ce-1d94-4427-83de-f49c861b0582 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.614651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279851f-5ff6-47d3-a428-c9450cea88c8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.648797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.649533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.649892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.650267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.651037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.651447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.653060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.657888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 460/893] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.659157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.689219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.725222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb9ce-1d94-4427-83de-f49c861b0582 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.758790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.759404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.759672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.759940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.760682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] RBAC: Adding query filter params (interface=public, service_id=f49637b6b93c4c19870779546e64b7c6, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.761002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.762369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0635c-8b98-4f7b-84b2-5e4b12548b29 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.765330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0187-4835-4543-b8ea-b8a5c09b0e23 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.767206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 434/894] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/endpoints?service_id=f49637b6b93c4c19870779546e64b7c6&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.768449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.768734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.769028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.786409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:02.787570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:02.811653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.812264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.812536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.812811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.813521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.813820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.815159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.822473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.826916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 461/895] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.827701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.856338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 435/896] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:02.857196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:02.911900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:02.926878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1a10-996d-43eb-9d91-bd855c9926c5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.959764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:02.960925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:02.961257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:02.961624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:02.962290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:02.962589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:02.963942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:02.965728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e52f54-11be-488e-822e-e16845b90b1b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:02.968489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 462/897] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:02.969270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:03.005103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:03.005847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:03.006123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:03.006389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:03.007160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:03.009204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:03.015311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 436/898] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/services => generated 1011 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:44:03.016127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:03.056129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:03.090619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e55a5f-f21c-4744-9bc4-fd9708ef3b5f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:03.134234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:03.135851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:03.136341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:03.136863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:03.139783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648bf6e-bbdd-4622-a9e2-2a8d5339564e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:03.145927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:03.148560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:03.162762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:03.163997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:03.164916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 463/899] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:03.170469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:03.181557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:03.182547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:03.183014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:03.183472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:03.184350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:03.186000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:03.192958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:03.207598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 437/900] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:03 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:03.300758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f52b3-2052-4034-9a32-13a1f95a4333 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:03.344242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:03.345202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:03.345659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:03.346076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:03.346985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:03.347437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:03.349148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9be9-c393-4e01-997f-e050d2df2e6a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:03.364940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 464/901] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:03.371390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:03.474316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:03.484322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64196ef-acaf-443a-8dc0-87244a77838f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:03.520518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:03.521167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:03.521439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:03.521708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:03.522489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] RBAC: Adding query filter params (role.id=cfaa0b2c18b14c0099cc3f04e564c525, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=ad7f47c74bc54f67bde9d523cd0b4936) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:03.522820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:03.524421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883fd74-cb08-4745-bff2-4c0cad4b6bbb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:03.530704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 438/902] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:03 2022] GET /identity/v3/role_assignments?user.id=ad7f47c74bc54f67bde9d523cd0b4936&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=cfaa0b2c18b14c0099cc3f04e564c525 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:05.085116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4bd4a-d384-4c96-bcb0-4537a0834737 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.086233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4bd4a-d384-4c96-bcb0-4537a0834737 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.086354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4bd4a-d384-4c96-bcb0-4537a0834737 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.087951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 465/903] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:05.093520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.093938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.094081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.112366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:05.113566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:05.148745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f027a-9775-4812-88ec-f863ad36a9f7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.149165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f027a-9775-4812-88ec-f863ad36a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.149493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f027a-9775-4812-88ec-f863ad36a9f7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.150986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 466/904] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:05.157214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.157736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.158228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.180446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:05.182385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:05.191719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 439/905] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:05.214208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.257893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.267140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 467/906] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:05.289809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.331985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.349193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdff749-fdc1-4a9f-9b61-29f127edd837 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.392946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.393592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.393872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.394143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.394835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.396204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf6d4-8769-405e-a437-867157415b70 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.402002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ed1a-6ff6-4245-b743-d28ca058fbb3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.411391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 440/907] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:05.412795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950510-3ad4-43d2-ae6f-f906a8cd0ff3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.413258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950510-3ad4-43d2-ae6f-f906a8cd0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.413976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950510-3ad4-43d2-ae6f-f906a8cd0ff3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.415542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 441/908] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:05.421873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.422385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.422830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.446161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:05.447616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:05.454213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.455064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.455343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.455618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.456267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.457772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:05.468690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:05.470044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:05.471054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 468/909] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:05.478435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.549684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 442/910] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:05.565928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.573274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.612296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59b8a-586d-48d2-8ead-9ec5058ad2d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.652139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.652451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.652722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.653009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.653720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:05.653993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.655343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f281d8-8532-4052-8834-ef8afcaaefc7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.660754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 469/911] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:05.661804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc703-20b5-42f6-bfa1-e9202e129e35 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.662086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc703-20b5-42f6-bfa1-e9202e129e35 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.662416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc703-20b5-42f6-bfa1-e9202e129e35 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.663623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 470/912] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:05.665872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.666164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afc703-20b5-42f6-bfa1-e9202e129e35 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.690940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff820c2-0796-4a5b-aae3-0417d2ae4a40 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.729883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.730528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.730805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.731075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.731702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.733105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-11dbf07e-4adf-4943-a12a-607b546e64d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:05.742238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:05.743153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:05.744022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 443/913] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:05.749627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.749916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.750189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.768444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:05.769651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:05.786988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afc703-20b5-42f6-bfa1-e9202e129e35 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.807239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.825353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.826269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.826772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.827193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.828042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:05.828495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.830278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.835817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 471/914] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:05.836589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.845079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 444/915] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:05.846090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:05.922469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:05.949015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac354f2-8259-4b36-9c61-b2fab9a6e719 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.952748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab508-cf07-4bd5-b37d-98847e82200f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:05.986468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.987095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.987376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.987478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:05.987656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.988072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:05.988321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:05.988419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:05.988621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.988717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:05.989365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:05.990068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:05.990751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.000117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 472/916] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:06.000117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.021032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 445/917] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:06.021032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.056374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.113882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29498c9-a013-4167-84bb-e30e3f5f9de5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.157547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.158455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.158907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.159318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.160865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0271d-6b1f-4cdf-9deb-2ab5cb359925 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.171994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:06.177851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:06.179488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:06.180607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:06.182900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 473/918] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:06.188587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.198125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.215593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.216234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.216515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.216790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.218654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:06.218654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.219877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.233061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 446/919] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:06.235272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.312038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8698c3-71a6-423e-b2a4-1349ad092599 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.314415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.348139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.348763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.349063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.349338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.350045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:06.350344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.351787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.358715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5e9-18e0-45ea-a6c5-405f397ca2fb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.364762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 474/920] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:06.365830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.403578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.404488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.404918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.405361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.406317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] RBAC: Adding query filter params (interface=public, service_id=c4010d288e8a49cbb58e11593fbc6834, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:06.406775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.408441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.414636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 447/921] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/endpoints?service_id=c4010d288e8a49cbb58e11593fbc6834&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:06.424732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.475599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e53d-d20f-4fae-bf10-cd192a6427bc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.489985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.514671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.515415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.515767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.516107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.528340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.529904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.544026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f397cd4-358e-4f52-86dd-868599d12737 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:06.546347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:06.547253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:06.548246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:06.548246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:06.548246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:06.548246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:06.548246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 475/922] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:06.561970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.585279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.586058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.586338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.586615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.587271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.588880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.589144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.598458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 448/923] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:44:06.695157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2b9fe-1a21-4328-bf42-438ad45c5102 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.735298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.735864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.736145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.736420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.737243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:06.737555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.738959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.753331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 476/924] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:06.759860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:06.871102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b60c-726d-4de6-bc7c-da5142eba4f4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:06.896100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:06.910121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:06.910766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:06.911048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:06.911324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:06.919574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:06.921034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:06.933081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:06.934012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:06.935312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 449/925] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:06.940528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.027670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:07.050256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ecb3b-a91b-4d50-8133-3309a6d36cb7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.086326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.086955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.087240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.087521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.088317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:07.088627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.090368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.110321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 477/926] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:44:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:07.116261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.222297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f7730-1a3e-428d-9645-c40ad9119c57 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.260186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.260832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.261143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.261418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.272537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.274984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:07.290286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:07.291193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:07.292616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:07.292616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:07.292616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:07.292616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:07.292616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 450/927] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:07.297448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.405921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739096-daf7-49a9-999c-1a5dfa7a01a8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.442805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.443432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.443718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.443995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.444723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:07.445096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.446388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664b8e-1384-4232-9a1c-4481dfac70ef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.448695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:07.461112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 478/928] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:07.467081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.496771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:07.570854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117750-378b-40ad-bd31-722e70e6d2e7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.572120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469133f-74b4-48ac-a7c9-730e243a9f37 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.572610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469133f-74b4-48ac-a7c9-730e243a9f37 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.573160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469133f-74b4-48ac-a7c9-730e243a9f37 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.575776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 479/929] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:07.579982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.580333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.580680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.600465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:07.602447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:07.611679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.613031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.613498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.614356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.623036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.625140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:07.642869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:07.643815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:07.644730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:07.653374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 451/930] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:07.654926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.682414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 480/931] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:07.706157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.778419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:07.804645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc489398-a30c-4412-b60a-beb8650462bd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.820758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079fd9d-152b-48ec-9e9b-a2eeca2ec48e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:07.853532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:07.856862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.858690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.859006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.859336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.860099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:07.860405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.862049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.867709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:07.868644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:07.869161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:07.870207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:07.871265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:07.873713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:07.875281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 452/932] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:07.880815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:07.886361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:07.887352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:07.888194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:07.896587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 481/933] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:07.899344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:07.992927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5bd5-d175-499f-8c2f-ad20c448e428 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.003909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df33-5f10-447e-a194-c675315d1fa1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.029965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.030637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.030921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.031197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/ad7f47c74bc54f67bde9d523cd0b4936/roles/cfaa0b2c18b14c0099cc3f04e564c525` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.033491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=ad7f47c74bc54f67bde9d523cd0b4936, role_id=cfaa0b2c18b14c0099cc3f04e564c525)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.035013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c656b-77cf-4fec-8626-53b55ec1aadc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.041594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.042401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.042787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.043126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.043921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:08.044277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.045805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.055901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 453/935] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:44:07 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/ad7f47c74bc54f67bde9d523cd0b4936/roles/cfaa0b2c18b14c0099cc3f04e564c525 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:44:08.056203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 482/935] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:08.057716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.122654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.156246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6c81-9add-41b9-8713-6bbde7453a42 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.156601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6c81-9add-41b9-8713-6bbde7453a42 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.156875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6c81-9add-41b9-8713-6bbde7453a42 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.158384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 454/936] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:08.166465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f911-3c23-467d-b554-da63979afd42 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.167049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f911-3c23-467d-b554-da63979afd42 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.167049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f911-3c23-467d-b554-da63979afd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.172680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ffc56-7825-4ad3-8a73-a4a37ea1533b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.196419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8698f911-3c23-467d-b554-da63979afd42 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:08.198462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8698f911-3c23-467d-b554-da63979afd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:08.204479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.210414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.211204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.211484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.211761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.212444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:08.212748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.214230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.227424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 483/937] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:08.228967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.289622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 455/938] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:08.314002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f911-3c23-467d-b554-da63979afd42 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.345265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262550e-ad95-4283-a6ad-17ac612640d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.362422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.383004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.383676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.383949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.384216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.384963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] RBAC: Adding query filter params (interface=public, service_id=e27e8ccb7ec94e8994803eb194aeb8e2, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:08.385287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.386634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.402718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 484/939] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/endpoints?service_id=e27e8ccb7ec94e8994803eb194aeb8e2&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:08.404185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.443913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f911-3c23-467d-b554-da63979afd42 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.486167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.487052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.487421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.487788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.489186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.490172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.493501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING keystone.server.flask.common [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 06:44:08.502655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.514529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.sql.core [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 06:44:08.514529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 06:44:08.514529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [parameters: {'id': '6548f76ca101461087112eb9f0ef88ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 06:44:08.514529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80212) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6548f76ca101461087112eb9f0ef88ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6548f76ca101461087112eb9f0ef88ea. Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:44:08.524675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 06:44:08.525555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application yield resource Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise self.value Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application session.commit() Aug 04 06:44:08.526520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.flush() Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application compat.raise_( Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 06:44:08.527404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 06:44:08.528306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:44:08.530146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [parameters: {'id': '6548f76ca101461087112eb9f0ef88ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:08.532239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:08.534279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6548f76ca101461087112eb9f0ef88ea. Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 456/940] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Aug 4 06:44:08 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:08.536428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.540447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb53e6-712a-4f46-8be2-5a45286aa880 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.578080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.579266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.579759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.580238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.581224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.582827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.592850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 485/941] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:44:08.655198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f481-c082-401a-8c41-d93398ce13bc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.697739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.698799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.699302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.699776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.708208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.710862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4921efb7-75ab-46db-a08c-87ac9382cef8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:08.724075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:08.725118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:08.726179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:08.729023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 457/942] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:08.738410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.784106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dfd9-8b3d-476a-8c2f-cfec55329547 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.784317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dfd9-8b3d-476a-8c2f-cfec55329547 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.784687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dfd9-8b3d-476a-8c2f-cfec55329547 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.788895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 458/943] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:08.792873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.794670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.794966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.795295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.815257 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:08.816772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:08.859754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd59e7a-e8a8-4108-8834-8f34ed681f4f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:08.881407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:08.889017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 459/944] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:08.901342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:08.902252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:08.902806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:08.903238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:08.904166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:08.904634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:08.906376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:08.912715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:08.925764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 486/945] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:09.029111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0749c9-78c3-4af0-9bc7-13ffce74755a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:09.067149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:09.067999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:09.068370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:09.068736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:09.069547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:09.071110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:09.081204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:09.082454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 06:44:09.083514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:09.086216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 460/946] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 06:44:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:09.092326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:09.194877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548111ba-e43a-41d7-8698-e83afb60727e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:09.202845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:09.235003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:09.235910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:09.236338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:09.236766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:09.237635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:09.238095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:09.239605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:09.245965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 487/947] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:09.253025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:09.305100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:09.359557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567770fd-b71e-494a-ad28-e81308f56d88 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:09.395494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:09.396254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:09.396660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:09.397038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:09.397789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:09.398091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:09.399444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03126547-121b-4b9c-a871-fec379994a3b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:09.404808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 461/948] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:09.410407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:09.513408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502b3a-1378-49cf-8a5f-371bd91a87b2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:09.547386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:09.548001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:09.548273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:09.548538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:09.549269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:09.550610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f62ea-eac0-4ccf-850a-3c55c01ff2f3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:09.574335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 488/949] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:10.191707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224274f-5b1b-4752-9539-af5342cbe853 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.192121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224274f-5b1b-4752-9539-af5342cbe853 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.192305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224274f-5b1b-4752-9539-af5342cbe853 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.193867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 462/950] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:10.199485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.199774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.200046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.218748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:10.219927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:10.240634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:10.295142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 489/951] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:10.318466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224274f-5b1b-4752-9539-af5342cbe853 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.424118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224274f-5b1b-4752-9539-af5342cbe853 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:10.437460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:10.458255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:10.458877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.459158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.459429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.471351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:10.477010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:10.477966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:10.479197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 463/952] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:10.484506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.590115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76ed1-2eb1-46ef-960c-dfa15b4f9af3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:10.625971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:10.626593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.626869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.627173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.627842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:10.628141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:10.629522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8afae-bf56-44f3-8886-c7f0a3aa4d5c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:10.638562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 490/953] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:10.644001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.717785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a6f8-9f31-4c23-a9c8-619543c22a65 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.718058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a6f8-9f31-4c23-a9c8-619543c22a65 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.718267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a6f8-9f31-4c23-a9c8-619543c22a65 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.719862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 491/954] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:10.724799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.725123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.725403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.744534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:10.745796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:10.752566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5281-64b1-4cd0-8da8-3a47ddcea768 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:10.769374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:10.789022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:10.789747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.790020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.790289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.801386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:10.802837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:10.817389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:10.818370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:10.819352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:10.819352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:10.819352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:10.819352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:10.823899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 464/955] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:10.824785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.825139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 492/956] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:10.846065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.853167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:10.928843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d9f6e-9bcb-4d82-9b29-0733bae9c31c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:10.961740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d3c8-9c61-4942-be92-0460e7537136 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:10.965658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:10.966633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.967089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.967537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.968757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:10.969236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:10.971612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:10.989235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 465/957] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:10.991339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:10.997675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:10.998353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:10.998636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:10.998941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:10.999639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.001044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:11.011213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:11.012301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:11.013314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 493/958] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:11.020684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.034051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.081394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.101699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282293d0-5def-4553-85b3-d267fc58b9df None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.139704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc32031-27b3-46ef-b12e-376ffa4c12e9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.147142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.149572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.150080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.150989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.160762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.163089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.176771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.177429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.177710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.177984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-28f11a37-cd4a-4f26-8b6f-cee554ea0c1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:11.178473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:11.179612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 06:44:11.180590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.181718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:11.181718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.181877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 466/959] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:44:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:11.181963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae89f-4939-48be-ad23-d484814d6b98 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.182049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac61369-40a8-450f-81d6-be3d3f1e0a1c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.182129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac61369-40a8-450f-81d6-be3d3f1e0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.182363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac61369-40a8-450f-81d6-be3d3f1e0a1c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.184069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 467/960] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:11.185398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac61369-40a8-450f-81d6-be3d3f1e0a1c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.190117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 494/961] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:11.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.192102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.192574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.211717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:11.212894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:11.286866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 495/962] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:11.288039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.290917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.301168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac61369-40a8-450f-81d6-be3d3f1e0a1c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.343620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.344288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.344593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.344938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.345855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:11.346231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.347747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.368085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 468/963] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:11.369361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.372172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.399794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528666ac-72a3-4ff0-8587-5705eea136db None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.436160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.436870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.437255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.437599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.438342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:11.438721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.440394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.445625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 496/964] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:11.446476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.481036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2741e5-e6d3-4a87-bd5d-f241199de4d6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.521141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.524368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.525307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.525587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.525859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.526695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.528929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.544962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.sql.core [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 06:44:11.544962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 06:44:11.544962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [parameters: {'user_id': 'f0e70a748b014abaa5e8f2c00cb82c03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 06:44:11.544962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80212) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:44:11.552039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:44:11.558103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application yield resource Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise self.value Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application session.commit() Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 06:44:11.559349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.flush() Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application compat.raise_( Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 06:44:11.560260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 06:44:11.561206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 06:44:11.562074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f0e70a748b014abaa5e8f2c00cb82c03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:11.562926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 06:44:11.563829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 469/965] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 06:44:11 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:11.566148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.575157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb825c1-38b1-4221-bd2b-be70a2486c4b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.616453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.617106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.617387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.617657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.623096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.665096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2aaef-a46f-4138-a78f-d0e1c35c8278 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.696650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.699918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f541-af3b-4878-a1a1-bc48c40ec1b1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.707347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.708039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.708390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.708739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.709483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.711127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.734983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 470/966] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:11.735795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.767615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.812821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 497/967] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:11.812821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134885-9f40-49d8-b95c-74560863fd03 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.812821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134885-9f40-49d8-b95c-74560863fd03 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.812821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134885-9f40-49d8-b95c-74560863fd03 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.812821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 498/968] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:11.813871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134885-9f40-49d8-b95c-74560863fd03 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:11.884806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd781-8e25-4a32-b365-262b3118b706 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.903939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:11.925086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.925729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.926002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.926439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.934358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.935789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:11.936205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134885-9f40-49d8-b95c-74560863fd03 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6a2be1fb-652c-4619-af8c-233f8f45cde1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:11.949992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:11.950966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:11.952145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 471/969] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:11.952799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3784882-5384-4003-b3fd-0e82426818af None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.952974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3784882-5384-4003-b3fd-0e82426818af None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.953922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3784882-5384-4003-b3fd-0e82426818af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.975542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a3784882-5384-4003-b3fd-0e82426818af None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:11.975801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:11.976387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:11.976672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:11.976951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:11.978389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a3784882-5384-4003-b3fd-0e82426818af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:11.987109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:11.988548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:12.004819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:12.005954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 499/970] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:12.007948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.030076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.061033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 472/971] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:12.061033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3784882-5384-4003-b3fd-0e82426818af None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.128506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb9e0-cfaa-4de9-be87-4ec571dcf84b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.163998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.164608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.164893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.165197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.165954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.166251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.167659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.174516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3784882-5384-4003-b3fd-0e82426818af None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.183372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.213075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 500/972] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:12.213075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.226556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.227426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.227896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.228179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.228888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.229241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.230665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.248361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 473/973] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:12.254089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.310612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.339338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69ac4-3636-4944-bcd0-fb807a343e61 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.379176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.379857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.380262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.380570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.381225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.383200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:12.392523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:12.393775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:12.395045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 501/974] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:12.403270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13cea-dc0d-4522-ae4f-3024a6f60757 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.404729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.445725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.446391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.446745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.447021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.454563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.456014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:12.468500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:12.469491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:12.470390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:12.471375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 474/975] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:12.477246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.509643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.535052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a8fc1-3527-4e21-98d6-89090d3da8aa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.571732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.572350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.572629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.572927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.573606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.573912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.575245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.581017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 502/976] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:12.585644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.589744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.593080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f4d7c-48b2-4334-8414-d6fca9739ac1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.627768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.628388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.628667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.628939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.629763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.630016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.631438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.644324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 475/977] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:12.650979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:12.702267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145683c-1961-4ebb-83bd-2ee8a6272c2a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.740058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.740673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.740970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.741268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.742205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.742508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.744027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e605-370c-4c34-8023-df47229ace43 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.746052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:12.761033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 503/978] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:12.763359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16a24c-36d0-464b-9a22-bb39e188435f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:12.802383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:12.803027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:12.803306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:12.803633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:12.804457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] RBAC: Adding query filter params (role.id=cfaa0b2c18b14c0099cc3f04e564c525, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=ad7f47c74bc54f67bde9d523cd0b4936) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:12.804765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:12.806296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ce4a0-01de-4925-bcba-b79c8b742384 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:12.813207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 476/979] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:12 2022] GET /identity/v3/role_assignments?user.id=ad7f47c74bc54f67bde9d523cd0b4936&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=cfaa0b2c18b14c0099cc3f04e564c525 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:13.793829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567448b3-8a99-4efd-90ed-cdd37fb20852 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:13.794333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567448b3-8a99-4efd-90ed-cdd37fb20852 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:13.794408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567448b3-8a99-4efd-90ed-cdd37fb20852 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:13.795852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 504/980] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:13.800792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:13.801216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:13.801374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:13.819634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:13.820810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:13.892733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 477/981] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:13.915136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567448b3-8a99-4efd-90ed-cdd37fb20852 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:13.984968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:14.020306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567448b3-8a99-4efd-90ed-cdd37fb20852 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:14.053459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:14.054098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.054384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.054651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.055268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:14.056611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:14.065236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:14.066176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:14.067103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:14.069883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 505/982] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:14.075124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:14.152826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:14.173021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d37e0c-3dc0-4786-85a2-ecf607e55dd0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:14.207524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:14.208142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.208417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.208685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.209377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:14.210331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:14.211845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:14.217119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 478/983] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:14.222793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:14.323014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53d36-73d7-41f6-a936-00d186929efe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:14.352499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:14.358577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:14.359200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.359473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.359739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.360412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:14.360711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:14.362130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:14.368546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 506/984] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:14.374182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:14.474044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0ac3-ba99-45ea-899c-df22d79380c6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:14.509031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:14.509646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.509920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.510186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.510933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] RBAC: Adding query filter params (interface=admin, service_id=e27e8ccb7ec94e8994803eb194aeb8e2, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:14.511239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:14.512589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc8ab5-b224-4cf9-b84a-8c01392e5803 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:14.517797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 479/985] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Aug 4 06:44:14 2022] GET /identity/v3/endpoints?service_id=e27e8ccb7ec94e8994803eb194aeb8e2&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:14.524090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:14.623216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a38c-2c17-4d72-bd12-ac903c14844b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:14.657706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:14.658322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.658596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.658864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.659502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:14.660904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616058-0a35-40fd-8a6a-822ee07c5374 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:14.667563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 507/986] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:14 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:44:14.770788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a917d-afc2-467a-bd62-4d587db69f1c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.771116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a917d-afc2-467a-bd62-4d587db69f1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.771334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a917d-afc2-467a-bd62-4d587db69f1c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.773031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 480/987] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:14.778679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.778998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.779234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.798443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:14.799640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:14.864689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:14.867649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d19e7-f6cb-42d3-bc39-8e632ae7e873 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.868128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d19e7-f6cb-42d3-bc39-8e632ae7e873 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.868206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d19e7-f6cb-42d3-bc39-8e632ae7e873 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.869719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 481/988] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:14.874865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:14.875381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:14.875624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 508/989] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:14.876075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:14.895617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:14.897196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:14.899585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:14.900703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:14.973156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 482/990] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:14.992605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:15.006380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3befa-1ad1-49de-bebd-531806daa487 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:15.042512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:15.043141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:15.043414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:15.043685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:15.044372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:15.045835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:15.069008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 509/991] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:14 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:15.111102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcfb3-3f96-4097-b63d-765d4a1169fe None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:15.158968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:15.159552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:15.159828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:15.160099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] PATH_INFO: `/v3/services/image` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:15.160731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:15.162186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:15.164968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:15.173689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:15.175026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:15.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:15.179042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 483/992] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 06:44:14 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:15.184853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:15.239270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:15.291836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3fbe-744f-4e12-b0b9-1c6f362ff63a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:15.325376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:15.325997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:15.326278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:15.326548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:15.327208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:15.327505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:15.328848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c977-5d55-4ce6-b0bb-03b82739e8d0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:15.338478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 510/993] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:15.340309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:15.444888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e1f8-dcd2-45da-aee5-95f10c80916e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:15.479106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:15.479770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:15.480045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:15.480313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:15.481049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] RBAC: Adding query filter params (type=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:15.481351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:15.482701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8b34-6d2b-41b5-a659-64625e9dba31 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:15.487307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 484/994] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:16.717292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82df3-13f5-44ca-9644-c6f505d9b58f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:16.717781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82df3-13f5-44ca-9644-c6f505d9b58f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:16.717884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82df3-13f5-44ca-9644-c6f505d9b58f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:16.719306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 511/995] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:16.724309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:16.724703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:16.724871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:16.743439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:16.744607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:16.801374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:16.813483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 485/996] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:16.835804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f82df3-13f5-44ca-9644-c6f505d9b58f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:16.939336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f82df3-13f5-44ca-9644-c6f505d9b58f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:16.952934 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:16.973783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:16.974495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:16.974840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:16.975732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:16.976408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:16.977851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-922559b3-54c8-49bb-accb-a086308c629f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:16.986677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:16.987838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 06:44:16.988881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:16.993320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 512/997] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 06:44:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:16.996102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.095409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453e0f0-8a45-4409-a65e-e49b50c6492e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.130151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.130768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.131042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.131336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.132081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:17.132378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.133764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.138767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 486/998] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:17.143925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65ae1-951a-4384-a584-9a93bc283afa None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.144147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.144807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65ae1-951a-4384-a584-9a93bc283afa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.145126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65ae1-951a-4384-a584-9a93bc283afa None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.146613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 513/999] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:17.152086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.152373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.152650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.171680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:17.172852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:17.204570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:17.245177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 514/1000] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:17.253207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0d30-465f-4964-b30b-6180f7bcaf6b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.268248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.287885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.288524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.288759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.289052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.289723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:17.290023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.291381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.296923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 487/1001] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:17.302343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.375374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e762-833f-43fb-a36e-eb334bfcb3ec None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.386510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:17.410927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9326acd-c6a5-4242-b06d-57446d83066c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.416489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.417295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.417680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.418057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] PATH_INFO: `/v3/services/compute` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.418791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.420657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:17.432165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:17.433374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:17.434393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:17.435355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 515/1002] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:17.438376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:17.440656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.452530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.453187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.453472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.453750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.454460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.455878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067fc5-80ba-4957-ad8d-6e107c741729 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.472743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 488/1003] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:17.512669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211dc0-d37e-4334-ae9c-7851c80d16fc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.513041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211dc0-d37e-4334-ae9c-7851c80d16fc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.513484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211dc0-d37e-4334-ae9c-7851c80d16fc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.515539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 489/1004] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:17.521348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.521632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.521910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.541912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:17.543150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:17.566635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46260-07de-444e-a46d-ba661acc60da None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.618728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.619391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.619672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.619947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.620627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:17.620940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.622357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.629022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 490/1005] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:17.629196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 516/1006] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:17.634003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.650633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.688352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:17.746949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144095f-7aec-49a9-a9f8-c51c9f14a8ca None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.755244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:17.771781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487558-80c8-43b4-8f7c-7ee755a70981 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.790535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.791162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.791442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.791712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.792385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:17.792687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.794094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.799205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 491/1007] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:17.805649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:17.810760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.811385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.811665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.811939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.812637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.814287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.830350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 517/1008] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:17 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:17.918480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683343-25b4-4028-b7ff-d5ab01b15996 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:17.963036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:17.963670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:17.963943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:17.964210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:17.965252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] RBAC: Adding query filter params (interface=public, service_id=c4895a866c9a4c45a16e758eb2113a80, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:17.965563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:17.966932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7abf1a-f92e-434c-8fd3-046b65a6f929 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:17.977045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 492/1009] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/endpoints?service_id=c4895a866c9a4c45a16e758eb2113a80&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:17.979704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:18.076293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:18.087057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed52bea-20dc-4ea2-8176-e8c068387788 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:18.121414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:18.122039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:18.122322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:18.122594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:18.123312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:18.124672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a374e3-2f86-4c3b-882d-c9c9b3d3b752 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:18.137059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 518/1010] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:17 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:44:19.523321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72882-f525-48a0-b72d-5aaa5db92b7b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.523950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72882-f525-48a0-b72d-5aaa5db92b7b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.523950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72882-f525-48a0-b72d-5aaa5db92b7b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.525271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 493/1011] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:19.530351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.530768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.530943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.549011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:19.550178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:19.616844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 519/1012] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:19.639255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72882-f525-48a0-b72d-5aaa5db92b7b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:19.671846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:19.746370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72882-f525-48a0-b72d-5aaa5db92b7b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:19.780358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:19.780925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.781245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.781514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.782658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:19.784079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03396318-120d-4df9-9935-b2451515dd65 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:19.786777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 494/1013] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:19.792230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:19.877216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:19.893412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ebe7c-1857-4f47-883f-e3c6a3f75270 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:19.929149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:19.930203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.930691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.931161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.932388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:19.935013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:19.941239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2ac5-3d28-4dbc-9c5d-aaf0d0425c53 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.941692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2ac5-3d28-4dbc-9c5d-aaf0d0425c53 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.942132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a2ac5-3d28-4dbc-9c5d-aaf0d0425c53 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.945030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 495/1014] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:19.949956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67c09-55af-4b47-9bd3-965c0f8cc273 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:19.950356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67c09-55af-4b47-9bd3-965c0f8cc273 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:19.950633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67c09-55af-4b47-9bd3-965c0f8cc273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:19.968586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 520/1015] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:19 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:19.978672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ede67c09-55af-4b47-9bd3-965c0f8cc273 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:19.980020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ede67c09-55af-4b47-9bd3-965c0f8cc273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:20.059148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 496/1016] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:20.082026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.164089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6971-9c0f-40f0-a26e-8fc8ec9cc67e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.164379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6971-9c0f-40f0-a26e-8fc8ec9cc67e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.164647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6971-9c0f-40f0-a26e-8fc8ec9cc67e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.166035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 497/1017] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:20.171434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.171723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.172001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.190602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef6ac-923f-47bb-af1c-2bc41d402594 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.192465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:20.193697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:20.219308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.230034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.230707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.230959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.231232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.231854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.233240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:20.242867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:20.244068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:20.245144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 521/1018] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:20.252099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.255312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.281133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 498/1019] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:20.301636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.361761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eff0d-a5b1-4507-a7b3-8d3bbbed59e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.401183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.401808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.402090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.402362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.403031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] RBAC: Adding query filter params (name=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:20.403332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.404683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.409930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 522/1020] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:20.415385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.419722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4d3d-341d-4bac-8a58-93681707271f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.460404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.461360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.461788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.462060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.462681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.464040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:20.473460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:20.474657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 06:44:20.475683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:20.480037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 499/1021] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:20.481389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.492476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.508820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.530631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be55c-23e4-4011-a058-84352cb427dd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.567513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.568265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.568548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.569696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.570477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:20.570785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.572253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.577329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 523/1022] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:20.583554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.592530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cee95-5c7b-443a-afb5-09a244ca1247 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.626646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.627188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.627468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.627747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.628416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] RBAC: Adding query filter params (name=compute) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:20.628719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.630151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.635741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 500/1023] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:20.641420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.697479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6555-0242-4322-8017-65354e153fa1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.726339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.732679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.733435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.733787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.734130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.734956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] RBAC: Adding query filter params (interface=public, service_id=dccca100e57541db9fd543970bb34dac, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:20.735332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.736773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.742404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 524/1024] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/endpoints?service_id=dccca100e57541db9fd543970bb34dac&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:20.747784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.755119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:20.771160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f689c-7e29-4ef4-930e-a152e24c32be None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.807218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.807978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.808361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.808759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.809538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:20.809941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.811397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.816358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 501/1025] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:20.822448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:20.854670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee938f3-c509-4265-8e6c-d052b8a40acd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.889149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.889808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.890083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.890347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.891035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.892725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5663901-f5f3-494c-bbb8-9ffcfdac9276 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:20.909009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 525/1026] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:44:20 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:44:20.937742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e247ce-ef1d-4eb6-84fe-21aa06a59b6d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:20.975644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:20.976383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:20.976736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:20.977114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:20.977908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:20.979375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d776c7-91bb-46c1-bdbd-99341587c0d5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:21.003673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 502/1027] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:22.061727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe890-5ba6-4993-9132-1fffe6170a52 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.062223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe890-5ba6-4993-9132-1fffe6170a52 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.062301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe890-5ba6-4993-9132-1fffe6170a52 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.063803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 526/1028] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:22.068825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.069312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.069403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.082251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:22.090359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:22.091919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:22.165897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 503/1029] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:22.190902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe890-5ba6-4993-9132-1fffe6170a52 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:22.252355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:22.297293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe890-5ba6-4993-9132-1fffe6170a52 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:22.330515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:22.331088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.331368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.331640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.332781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:22.334878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fcfe1-4073-400c-a1f2-d3bf586fa02a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:22.336681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 527/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:22.342407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:22.442000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ababcf1-5c0a-4d2b-b2d0-355c3e001c49 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:22.472080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:22.478250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:22.478874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.479155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.479427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.480122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:22.481584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5506c-1b9c-4b30-8a8f-c03be12977b7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:22.503277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 504/1031] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:44:22 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:22.927246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620a1-321a-4555-880f-80dee303e2af None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.927616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620a1-321a-4555-880f-80dee303e2af None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.927795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620a1-321a-4555-880f-80dee303e2af None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.929486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 528/1032] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:22.934407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd910b-cec3-4471-aea4-aaa4cebac531 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:22.934770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd910b-cec3-4471-aea4-aaa4cebac531 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:22.935214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd910b-cec3-4471-aea4-aaa4cebac531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:22.954387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1bbd910b-cec3-4471-aea4-aaa4cebac531 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:22.955613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1bbd910b-cec3-4471-aea4-aaa4cebac531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:23.025519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 505/1033] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:23.047834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288620a1-321a-4555-880f-80dee303e2af None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.122992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4551-a779-4c27-a80b-cb58535728c3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.123530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4551-a779-4c27-a80b-cb58535728c3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.123530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4551-a779-4c27-a80b-cb58535728c3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.125054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 506/1034] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:23.129820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.130103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.130382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.149491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:23.150674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:23.152485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288620a1-321a-4555-880f-80dee303e2af None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.177602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:23.192074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.192716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.193009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.193287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.194447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.195899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:23.205126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:23.206121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:23.206974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 529/1035] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:23.217584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.233932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 507/1036] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:23.258127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.314682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:23.327303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21462327-49fe-473e-a6f7-1bbdac9f88c1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.365018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.366565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.366990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.367632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.368238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] RBAC: Adding query filter params (name=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:23.368602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.369256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65400-db88-4ae2-9a5f-ed35750626f9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.370186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.377122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 530/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:23.381782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.411580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.412364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.412825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.412825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.423738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:23.430068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:23.431043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:23.431905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 508/1038] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:23.437105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.442431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:23.492406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee5b51-7ee2-482a-a786-875b02ec12ae None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.530221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.531187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.531686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.532139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.533012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] RBAC: Adding query filter params (type=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:23.533760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.535250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.545366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 531/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:23.545521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd3c1d-5edc-4b60-867c-b125127d6193 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.546653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.555871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:23.583185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.583832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.584851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.585161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.585784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:23.586140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.587513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.596134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 509/1040] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:23.602576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.661202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99041a-e203-4f95-a793-966356b83d60 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.682985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:23.706271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.706894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.707179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.707445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.708163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.710180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.715534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04397d1-2124-444e-a7c2-2e89ecc8094a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.731450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 532/1041] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:44:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:44:23.774151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.775527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.776184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.776817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.791020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.792909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:23.809692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:23.810779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:23.816638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:23.816638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:23.816638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:23.816638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:23.816638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 510/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:23.817532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:23.925833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d785a9-9fe1-4f93-b887-adad60fb82f8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:23.963071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:23.963697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:23.963979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:23.964507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:23.965228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:23.965534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:23.966892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:23.979177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 533/1043] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:23.984872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.005648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.091278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00007960-d2f2-4422-907e-4ac2ec0cab71 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.125378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.126006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.126283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.126555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.135160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:24.136649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:24.148391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:24.149618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:24.150572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 511/1044] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:44:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:24.155257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.190472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.263083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b52fa-aefd-413a-a898-999da070064f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.298295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.298911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.299184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.299460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.300249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:24.300557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:24.301994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc258214-608d-41ec-8c16-c47c647c77e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:24.324891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 534/1045] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:24.326540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.406624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.429611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7d39d-349d-401f-a90b-69987f4e2344 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.464627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.465266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.465551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.465823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.536009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:24.538635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:24.584790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fe1a-98fc-424b-ad6b-7c3b2ecf534c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.585271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fe1a-98fc-424b-ad6b-7c3b2ecf534c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.585689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fe1a-98fc-424b-ad6b-7c3b2ecf534c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.587163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 535/1046] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:24.592126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.592407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.592682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.612463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:24.613679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:24.619971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.647961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 512/1047] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 06:44:24.649067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.691156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 536/1048] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:24.715187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.740864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.764576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91254078-d27e-422b-9bca-b25fd4457c5f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.802192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.803382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.803774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.804279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.814679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:24.816124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:24.823033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15c31f-8642-4397-983d-afd88a193e32 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:24.832240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:24.833384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:24.835118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:24.835118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:24.835118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:24.835118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:24.835118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 513/1049] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:24.839809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.863211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.864196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.864668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.864940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.875774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.878467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:24.883638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:24.884641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:24.885551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:24.889792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 537/1050] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:24.890898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:24.954986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25378c-93d8-4f12-b08c-cfcf2de3b72d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:24.977800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:24.993415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:24.994032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:24.994311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:24.994583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:24.995264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:24.995557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:24.997007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:24.997620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661c304-a18b-4e1a-9648-baaf3a3f7c33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.009274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 514/1051] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:25.014365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.038089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.038838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.039117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.039386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.040091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:25.040397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.041923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.050387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 538/1052] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:25.055728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.109952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.121933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686857be-e35f-47a7-a1be-3003e6959513 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.157964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.158712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.158966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.159242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.165820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059679e-54d9-43d6-a7e2-5fd39b667bc2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.166982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.168732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:25.180275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:25.181356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:25.182784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 515/1053] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:25.186933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.205732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.206305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.206590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.206866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] PATH_INFO: `/v3/users/517a8a1a3d3f4640b8399d6f15263f8b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.222692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] RBAC: Authorizing `identity:get_user(user_id=517a8a1a3d3f4640b8399d6f15263f8b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.224135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.226426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 539/1054] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/users/517a8a1a3d3f4640b8399d6f15263f8b => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:25.232088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.235135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.299265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a481b-2af0-451f-8ac9-b911b5fd68c8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.334333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae529-8ffc-4dbf-a642-65d808137a00 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.341834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.342825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.343106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.343372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.344111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:25.344415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.345867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.364610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 516/1055] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:25.366672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.372448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.373109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.373393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.373664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.379856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.444993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.446500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.448340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.474993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f85d-5a20-43ad-a774-4754f981b60b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.513102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.513722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.514002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.514276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.515060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] RBAC: Adding query filter params (role.id=cfaa0b2c18b14c0099cc3f04e564c525, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:25.515368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.516786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.523445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 517/1056] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=cfaa0b2c18b14c0099cc3f04e564c525 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:25.558388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 540/1057] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 06:44:25.560438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.643675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.672682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07765-c2b5-4c13-8dfa-4d39a399c53a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.717552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.718199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.718530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.718806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.719941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.721392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae956-8338-4479-8c46-84bf321288a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.728230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 518/1058] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:25.729586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:25.816205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b20a7-ec64-422c-868f-586c5777c3ff None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.816541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b20a7-ec64-422c-868f-586c5777c3ff None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.816761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b20a7-ec64-422c-868f-586c5777c3ff None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.818428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 519/1059] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:25.823772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.824056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.824336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.830273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796780b-997f-4f0a-9a25-bb4b79fc60a9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:25.832782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:25.844038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:25.845253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:25.869966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:25.870591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:25.870869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:25.871143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:25.871923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f, user.id=517a8a1a3d3f4640b8399d6f15263f8b) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:25.872228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:25.873683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:25.879955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 541/1060] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/role_assignments?user.id=517a8a1a3d3f4640b8399d6f15263f8b&scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:25.924187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 520/1061] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:25.946921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:26.057658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956fee4-c55c-4cd9-b1e2-6b56d51c9066 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:26.093085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:26.093711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:26.093990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:26.094260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:26.129392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:26.166429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:26.167879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:26.273867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 542/1062] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:26.275362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:26.348182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:26.380156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20585b6-6706-4449-9203-599efe1edbf6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:26.414982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:26.415615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:26.415891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:26.416161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:26.426127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:26.427557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c8804d0c-e5e2-40d6-8392-4b5de136db05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:26.443169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:26.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:26.451016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:26.451016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:26.451016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:26.451016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:26.451016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 521/1063] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:26.451309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:26.517742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:26.554607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abe19-7dc8-460e-ab8f-9dc987a78a59 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:26.588461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:26.589445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:26.589783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:26.589960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:26.590588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:26.590890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:26.592225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b5f8-7af6-46b1-b64e-651eeabb797c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:26.609146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 543/1064] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:27.544504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baeb5b-f57f-4562-8ce6-8a77022e3896 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.545091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baeb5b-f57f-4562-8ce6-8a77022e3896 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.545091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baeb5b-f57f-4562-8ce6-8a77022e3896 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.546436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 522/1065] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:27.551749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.552151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.552301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.570757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:27.571927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:27.637359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 544/1066] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:27.659085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baeb5b-f57f-4562-8ce6-8a77022e3896 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:27.761184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baeb5b-f57f-4562-8ce6-8a77022e3896 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:27.784054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:27.795350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:27.795932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.796211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.796487 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.806858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d38203fb-ec08-4eb2-b7d0-4e861136ca10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:27.811733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:27.812672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:27.813564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 523/1067] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:27.818843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:27.866039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d628-48ed-4997-881f-6f8533986f88 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.866322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d628-48ed-4997-881f-6f8533986f88 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.866602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d628-48ed-4997-881f-6f8533986f88 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.867954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 524/1068] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:44:27.873878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.874026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:27.874172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.874456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.892068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:27.893336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:27.916787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e69fe-4e2f-41e6-81f8-2ea8342f3370 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:27.949493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:27.950109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:27.950388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:27.950661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:27.951365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:27.951666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:27.953067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:27.961509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 545/1069] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:27.962317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 525/1070] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:27.967225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:27.987043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.064607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364853f-83e0-4854-8731-76101d9934e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.081032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.085323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f80c3-2155-4642-9530-cbb872970cb3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.098561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.099198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.099338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.099550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.100304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.111138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.112574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.119078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.119705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.119987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.120264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:28.126524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:28.127527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:28.128437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:28.128437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:28.128437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:28.128437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:28.128437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 546/1071] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:28.130576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:28.133957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:28.136271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:28.137330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:28.138182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 526/1072] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:28.143205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.235685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c22cb-1279-44a0-8739-45ca0e25f2f2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.241807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292197-18b7-44d0-bd54-8e7f95bf73dd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.272047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.272664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.272946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.273239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.273941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:28.274238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.275578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.275964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.276579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.276859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.277165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.277872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:28.278175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.279520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.288146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 527/1073] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:28.289025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 547/1074] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:28.293953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.294076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.323781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.329201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.393263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd95f6-3d99-4637-b9aa-95079bfb9da9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.393668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb691f-4502-49aa-bce9-8f223ba3c64d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.426263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.426726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.426890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.427166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.427357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.427464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] PATH_INFO: `/v3/users/517a8a1a3d3f4640b8399d6f15263f8b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.428273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.428453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.429154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] RBAC: Authorizing `identity:get_user(user_id=517a8a1a3d3f4640b8399d6f15263f8b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.430559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.432133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 548/1075] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/users/517a8a1a3d3f4640b8399d6f15263f8b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:28.435999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.437452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.437678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:28.449002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:28.449974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:28.450925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:28.453538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 528/1076] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:28.455741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.531655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.535569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ad7e-5222-489a-ae7f-b6b9440a9ceb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.551215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.558064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f70c3-dc7f-493a-a6ff-b330270d8501 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.571578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.572224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.572501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.572774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.574001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.575356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.576999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 549/1077] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:28.582775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.593303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.593926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.594209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.594490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.595277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:28.595584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.597033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.614843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 529/1078] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:28.620550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.683369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9677474-0a8d-4395-8653-0dc02ca0598e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.720106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.720780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.721097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.721376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f/users/517a8a1a3d3f4640b8399d6f15263f8b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.723298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] RBAC: Authorizing `identity:create_grant(project_id=0cd5d50a709d4f3e9476990c40ca2f8f, user_id=517a8a1a3d3f4640b8399d6f15263f8b, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.725499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.725655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47219a6-9845-478a-8931-4a6628c0d719 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.739642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 550/1079] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:44:28 2022] PUT /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f/users/517a8a1a3d3f4640b8399d6f15263f8b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:44:28.761242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.761911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.762188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.762461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.774455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.775931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:28.792637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:28.793697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:28.794632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:28.794632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:28.794632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:28.794632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:28.794632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 530/1080] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:28.799875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.828748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:28.907275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cc0c-48e7-4a15-b4c9-f7a9d842479b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:28.940652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:28.941302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:28.941581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:28.941853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:28.942534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:28.942835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:28.944862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:28.956295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 551/1081] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:28.962745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:28.972240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:29.064549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac969c4-1b8c-44c2-a7d2-5d9532adb111 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:29.098530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:29.099092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:29.099565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:29.099849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:29.106373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:29.107807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:29.119017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:29.119915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:29.120906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 531/1082] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:29.125921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:29.210172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:29.225440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f9fd-00f1-4063-a27c-46d6fc10e769 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:29.258943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:29.259558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:29.259839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:29.260111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:29.260847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:29.261186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:29.262604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdb4e-3397-4bad-8bce-7bb99d672f1c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:29.274721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 552/1083] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:29.280774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:29.345604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:29.382514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445d1f7-0a15-4d23-b86b-bbaece027509 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:29.415380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:29.416046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:29.416324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:29.416594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/cfaa0b2c18b14c0099cc3f04e564c525` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:29.418755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=2245988d98b1408bba171ce6979796b0, role_id=cfaa0b2c18b14c0099cc3f04e564c525)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:29.420179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437d028-fe0b-45ef-b0aa-35244f8a41a1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:29.433188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 532/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:44:29 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/2245988d98b1408bba171ce6979796b0/roles/cfaa0b2c18b14c0099cc3f04e564c525 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:44:30.710438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d74bd-e666-4d64-8bee-faf1197bd2e3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:30.710923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d74bd-e666-4d64-8bee-faf1197bd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:30.711111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d74bd-e666-4d64-8bee-faf1197bd2e3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:30.712520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 553/1085] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:30.718061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:30.718454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:30.718613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:30.736917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:30.738125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:30.803863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 533/1086] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:30.826227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d74bd-e666-4d64-8bee-faf1197bd2e3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:30.924322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d74bd-e666-4d64-8bee-faf1197bd2e3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:30.956559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:30.957150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:30.957428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:30.957692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:30.968356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:30.973197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:30.974203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:30.975745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:30.977136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 554/1087] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:30.981312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.035623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.079648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c4ad-b5f4-4702-81db-802405445e0f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.113405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.114025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.114304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.114577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.115366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:31.115668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.117082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.125304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 534/1088] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:31.131544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.140564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.230708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c24ee-a941-49b0-87b8-9bd3f5d0363e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.263261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.264001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.264345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.264680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] PATH_INFO: `/v3/users/517a8a1a3d3f4640b8399d6f15263f8b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.265947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=517a8a1a3d3f4640b8399d6f15263f8b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.267355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56b5b2-b6cc-4b69-86f0-bb2d416e6dd8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.268942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 555/1089] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/users/517a8a1a3d3f4640b8399d6f15263f8b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:31.274822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.374380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb96a9-45b5-4fcf-9f40-c949b7c8ca74 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.391846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.409690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.410303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.410576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.410841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.428708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9710-88cb-4343-9db4-75ddddf24b0a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.429006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9710-88cb-4343-9db4-75ddddf24b0a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.429310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9710-88cb-4343-9db4-75ddddf24b0a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.430651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 556/1090] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:31.435454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.435738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.436011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.453982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:31.455186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:31.494201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.495580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.521901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 557/1091] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:31.545084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.548011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.594871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 535/1092] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 06:44:31.600822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.618667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.645295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127f0a-0f3a-4940-8251-8386c6657dcb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.680488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.681168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.681582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.681724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.691973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:31.696942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:31.697938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:31.699166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 558/1093] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:31.702832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4173-acf6-401b-93dc-43beb224c1e8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.704470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.739876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.740918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.740918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.741269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.742313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.743735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.745468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 536/1094] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:31.751383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.766544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.804906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4016d2-b85f-47df-8e10-2959a7f7ef33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.838495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.839377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.839657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.839928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.840633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:31.841063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.842167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.842294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.850958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 559/1095] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:31.856726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:31.858116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56fa4-cb60-4cde-80f5-1353421044f7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.892933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.893574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.893857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.894132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:31.894907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f, user.id=517a8a1a3d3f4640b8399d6f15263f8b) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:31.895212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:31.897483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:31.903254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 537/1096] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/role_assignments?user.id=517a8a1a3d3f4640b8399d6f15263f8b&scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:44:31.960272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb653a1-53fc-47dc-bbaa-a663c70a23f9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:31.986623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:31.996419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:31.997003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:31.997305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:31.997580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.009817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.011282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:32.028333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:32.029493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:32.030393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:32.030393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:32.030393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:32.030393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:32.030393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 560/1097] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:44:32.035459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:32.138300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749421-ac66-427e-b9b5-b839ed0cfdd3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:32.170758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:32.171372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:32.171648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:32.171917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.172597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:32.172896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.174282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.190375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 538/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:32.191574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:32.287905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23513333-fa25-4598-b594-fa452823cdd4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:32.319702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:32.320333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:32.320608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:32.320877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.328041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.329482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:44:32.342707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:32.343802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:32.344739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 561/1099] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:32.349557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:32.362608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:32.452619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507863-e502-4a0d-a116-6ae737fb8189 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:32.486649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:32.487258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:32.487531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:32.487797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.488569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:32.488868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.490506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.507120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 539/1100] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:32.512820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:32.552032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:32.611632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5efa2-55ed-4c89-a4f7-7aa4bd926981 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:32.644523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:32.645179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:32.645459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:32.645729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.713055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.714778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.751914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:32.810329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 562/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 06:44:32.816108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:32.881512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:32.914516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380eda-c311-4a3d-8711-2a3b27cbd31a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:32.947096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:32.947722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:32.947996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:32.948263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:32.957862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:32.959548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:32.975407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:32.976475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:32.977438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:44:32.977438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:32.977438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:44:32.977438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:32.977438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 540/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:32.982381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:33.083172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6ca-70b9-4c08-9ebf-06c6d10e00e9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:33.116884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:33.117520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.117795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.118064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.119039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:33.119340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:33.120721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:33.126946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:33.133738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 563/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:33.139505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:33.237523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278176e4-8f07-489e-850a-f45618d81cca None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:33.256557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:33.270748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:33.271934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.272212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.272470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.279089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:33.280524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:44:33.291782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:33.292780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:44:33.293721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:33.297117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 541/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:33.298769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:33.401078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6138-82fd-4f75-95c9-42f3b8ce3938 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:33.433804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:33.436542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.436837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.437142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.437881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:33.438183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:33.439590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ff91-19d3-4174-b45e-298dad45ae83 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:33.453231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 564/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:33.460364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:33.557207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c268c23-070a-4176-803a-6de942e9b6b2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:33.589589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:33.590188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.590462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.590727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.591501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] RBAC: Adding query filter params (role.id=cfaa0b2c18b14c0099cc3f04e564c525, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=2245988d98b1408bba171ce6979796b0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:33.591800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:33.593232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92e2f0-f40f-4120-a740-9149e553c713 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:33.598839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 542/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:33 2022] GET /identity/v3/role_assignments?user.id=2245988d98b1408bba171ce6979796b0&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=cfaa0b2c18b14c0099cc3f04e564c525 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:33.954829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7f2f5-16f4-4856-8900-60deefd9810c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.955320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7f2f5-16f4-4856-8900-60deefd9810c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.955320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7f2f5-16f4-4856-8900-60deefd9810c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.956648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 565/1107] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:33.962557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:33.963020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:33.963112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:33.981975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:33.983155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:34.025148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:34.055872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 543/1108] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:34.079915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7f2f5-16f4-4856-8900-60deefd9810c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:34.140652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:34.183855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7f2f5-16f4-4856-8900-60deefd9810c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:34.219041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:34.219609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:34.219887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:34.220160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:34.221319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:34.222742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a04b-d6cf-414b-96bf-e9bc9c1834be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:34.224469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 566/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:34.230432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:34.331831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab48ca-7edc-4134-b60e-8784c741770f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:34.368580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:34.369224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:34.369483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:34.369768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:34.370426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:34.371842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b8bac-4aa7-40fd-ac54-ae00f76de89d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:34.395240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 544/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:44:34 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:36.421600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1520f-1f51-43a2-bd80-d0fd605dcede None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:36.422153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1520f-1f51-43a2-bd80-d0fd605dcede None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:36.422153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1520f-1f51-43a2-bd80-d0fd605dcede None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:36.423480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 567/1111] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:36.429164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:36.429590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:36.429706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:36.447780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:36.448950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:36.472520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:36.516230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 545/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:44:36.540098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1520f-1f51-43a2-bd80-d0fd605dcede None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:36.636763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1520f-1f51-43a2-bd80-d0fd605dcede None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:36.662526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:36.671022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:36.671696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:36.671935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:36.672193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] PATH_INFO: `/v3/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:36.673622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] RBAC: Authorizing `identity:get_role(role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:36.674968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:36.676286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 568/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:36 2022] GET /identity/v3/roles/b145351ec6374b099e83fb311cea5308 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:36.682847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:36.778337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f16aa6-cee6-4219-9141-b7a46552a199 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:36.810968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:36.811592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:36.811868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:36.812139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] PATH_INFO: `/v3/users/8d0875f92e734703b4ffd05828ca76d1` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:36.824922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] RBAC: Authorizing `identity:get_user(user_id=8d0875f92e734703b4ffd05828ca76d1)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:36.826375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:36.827957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 546/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:36 2022] GET /identity/v3/users/8d0875f92e734703b4ffd05828ca76d1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:36.834345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:36.928178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b23c9-9eae-4401-986f-81f25d1a7e20 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:36.960178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:36.960774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:36.961077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:36.961348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:37.017285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:37.025339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:37.026776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:37.120177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 569/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:37.126146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:37.145146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:37.222878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c8bd-d17f-4ccc-bd2b-458111b94b50 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:37.254976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:37.256290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:37.256567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:37.256843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:37.258021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:37.259451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e1fa8-7729-4c42-aa68-971f40635c7e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:37.261099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 547/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:37 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:37.267090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:37.354389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:37.361282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449ca9b-abe9-4e62-b7f0-a2cfc2e76434 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:37.393952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:37.394552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:37.394828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:37.395097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:37.396631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f, user.id=8d0875f92e734703b4ffd05828ca76d1) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:37.396939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:37.398378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdba4c-a9b0-4d15-ba68-b912b13b2159 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:37.403501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 570/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:37 2022] GET /identity/v3/role_assignments?user.id=8d0875f92e734703b4ffd05828ca76d1&scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f&role.id=b145351ec6374b099e83fb311cea5308 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:39.363286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2356-2d6e-45e0-8af0-4c022ddc96a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:39.363913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2356-2d6e-45e0-8af0-4c022ddc96a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:39.363913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2356-2d6e-45e0-8af0-4c022ddc96a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:39.365628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 548/1118] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:39.370703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:39.371149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:39.371254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:39.389549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:39.390714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:39.454753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 571/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:39.478063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2356-2d6e-45e0-8af0-4c022ddc96a3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:39.562448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:39.579418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2356-2d6e-45e0-8af0-4c022ddc96a3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:39.612603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:39.613259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:39.613587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:39.613812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] PATH_INFO: `/v3/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:39.615268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] RBAC: Authorizing `identity:get_role(role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:39.616629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:39.617997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 549/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:39 2022] GET /identity/v3/roles/b145351ec6374b099e83fb311cea5308 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:39.623689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:39.706967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:39.719819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f7e57-d514-4f18-becc-be347bfe1b97 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:39.752536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:39.753202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:39.753485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:39.753763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] PATH_INFO: `/v3/users/8d0875f92e734703b4ffd05828ca76d1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:39.755482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] RBAC: Authorizing `identity:get_user(user_id=8d0875f92e734703b4ffd05828ca76d1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:39.756896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:39.758494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 572/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:39 2022] GET /identity/v3/users/8d0875f92e734703b4ffd05828ca76d1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:39.764289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:39.859306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33f63-edd1-449c-81fc-bebed14731a5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:39.892451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:39.893029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:39.893309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:39.893579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:39.894702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:39.896307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef894ef-a475-4062-ac0c-2608baca5109 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:39.897944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 550/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:39 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:39.903893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:40.001256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a4a8-e651-4d6e-8710-0413592d584c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:40.034095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:40.034742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:40.035021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:40.035293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f/users/8d0875f92e734703b4ffd05828ca76d1/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:40.037971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cd5d50a709d4f3e9476990c40ca2f8f, user_id=8d0875f92e734703b4ffd05828ca76d1, role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:40.039377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c7de-371d-459d-b285-c1a1578281d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:40.051429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 573/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:44:39 2022] PUT /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f/users/8d0875f92e734703b4ffd05828ca76d1/roles/b145351ec6374b099e83fb311cea5308 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:44:42.010874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb31c-8070-45d9-9371-a4f96c2bebce None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.011386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb31c-8070-45d9-9371-a4f96c2bebce None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.011386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb31c-8070-45d9-9371-a4f96c2bebce None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.012681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 551/1124] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:42.018019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.018415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.018563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.038316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:42.039477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:42.049755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:42.107531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 574/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:42.132172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb31c-8070-45d9-9371-a4f96c2bebce None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:42.156135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:42.231502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb31c-8070-45d9-9371-a4f96c2bebce None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:42.264287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:42.264852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.265158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.265432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] PATH_INFO: `/v3/roles/b145351ec6374b099e83fb311cea5308` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.266849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] RBAC: Authorizing `identity:get_role(role_id=b145351ec6374b099e83fb311cea5308)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:42.268205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:42.269543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 552/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:42 2022] GET /identity/v3/roles/b145351ec6374b099e83fb311cea5308 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:42.275917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:42.369854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3b970-40ce-47d3-98f8-d4661c4163f3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:42.402350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:42.402972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.403248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.403516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] PATH_INFO: `/v3/users/8d0875f92e734703b4ffd05828ca76d1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.404645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] RBAC: Authorizing `identity:get_user(user_id=8d0875f92e734703b4ffd05828ca76d1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:42.406082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:42.407615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 575/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:42 2022] GET /identity/v3/users/8d0875f92e734703b4ffd05828ca76d1 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:42.414053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:42.501089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:42.510633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbac0-664b-4878-b1e3-b32aa473db09 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:42.543436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:42.543982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.544262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.544535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.609556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:42.610994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:42.697548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:42.708875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 553/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:42.714917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:42.730030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:42.812674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b44856-0b2a-4f8e-904b-fe37b87d1eaf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:42.846497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:42.847133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.847413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.847688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] PATH_INFO: `/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.849009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd5d50a709d4f3e9476990c40ca2f8f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:42.850437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74189b30-dcf7-4ce2-bc4d-cde5c73a9805 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:42.852064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 576/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:42 2022] GET /identity/v3/projects/0cd5d50a709d4f3e9476990c40ca2f8f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:42.858110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:42.954580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463625-cb46-4f69-9254-d2110b3d7492 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:42.987084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:42.987679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:42.987956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:42.988228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:42.989017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] RBAC: Adding query filter params (role.id=b145351ec6374b099e83fb311cea5308, scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f, user.id=8d0875f92e734703b4ffd05828ca76d1) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:42.989850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:42.991262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48171837-cb81-44aa-8cd3-70eb46c75fd5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:42.996951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 554/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:42 2022] GET /identity/v3/role_assignments?user.id=8d0875f92e734703b4ffd05828ca76d1&scope.project.id=0cd5d50a709d4f3e9476990c40ca2f8f&role.id=b145351ec6374b099e83fb311cea5308 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:45.009701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da877f-ca13-458d-a092-a46efd910810 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:45.010227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da877f-ca13-458d-a092-a46efd910810 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:45.010227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da877f-ca13-458d-a092-a46efd910810 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:45.011485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 577/1131] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:45.016519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:45.016934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:45.017099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:45.035199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:45.037084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:45.086838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:45.104650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 555/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:45.127705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da877f-ca13-458d-a092-a46efd910810 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:45.209309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:45.228728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da877f-ca13-458d-a092-a46efd910810 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:45.261200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:45.261763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:45.262041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:45.262312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:45.263445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:45.264851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719ba8-29f0-4478-be0a-e7ad72453139 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:45.266416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 578/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:45.273037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:45.367350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a76c61-ea43-45d3-abdf-8c91f993c77f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:45.401374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:45.401978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:45.402249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:45.402517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:45.403187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:45.404596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e778c9b-11c1-4491-8857-40f4ad35a667 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:45.430413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 556/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:44:45 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:47.467896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86ae9-e65a-41bf-b532-79fc89db2c29 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:47.468464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86ae9-e65a-41bf-b532-79fc89db2c29 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:47.468464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86ae9-e65a-41bf-b532-79fc89db2c29 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:47.469805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 579/1135] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:47.475808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:47.476197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:47.476352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:47.494077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:47.495241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:47.523109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:47.560409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 557/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:47.585819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86ae9-e65a-41bf-b532-79fc89db2c29 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:47.683097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86ae9-e65a-41bf-b532-79fc89db2c29 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:47.716580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:47.717241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:47.717518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:47.717788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:47.719080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:47.720440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11be08-e56d-4b6f-b7b2-304fed5ee972 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:47.722016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 580/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:44:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:47.727687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:47.822607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4bc4-9be6-42cf-8d0f-9d23094d0e06 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:47.857540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:47.858135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:47.858411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:47.858681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:47.859337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:47.860746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a8b4b-2a5f-426c-a453-3d495ba44231 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:47.880968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 558/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:44:47 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:44:49.918260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37049-3386-4933-bad4-544b35c16a84 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:49.918803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37049-3386-4933-bad4-544b35c16a84 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:49.918803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b37049-3386-4933-bad4-544b35c16a84 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:49.920143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 581/1139] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:49.925241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41671-dc2e-4741-8b93-93487015678c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:49.925665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41671-dc2e-4741-8b93-93487015678c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:49.925792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41671-dc2e-4741-8b93-93487015678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:49.944153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-49d41671-dc2e-4741-8b93-93487015678c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:49.945370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-49d41671-dc2e-4741-8b93-93487015678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:49.962037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:50.012648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 559/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:50.036247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b37049-3386-4933-bad4-544b35c16a84 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:50.055986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:50.137379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b37049-3386-4933-bad4-544b35c16a84 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:50.170008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:50.170634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:50.170915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:50.171190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:50.181652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:50.186548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:50.187715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:50.188607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 582/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:50.193830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d41671-dc2e-4741-8b93-93487015678c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:50.289981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d41671-dc2e-4741-8b93-93487015678c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:50.322630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:50.323234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:50.323512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:50.323784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:50.324484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:50.324787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:50.326183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:50.334813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 560/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:50.340899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:50.415795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:50.436104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f616-4b5f-4314-8cfe-d16b498a2bd2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:50.468972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:50.469625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:50.469906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:50.470181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] PATH_INFO: `/v3/users/93bf552d7cee4eb2a435012967231c97` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:50.483925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] RBAC: Authorizing `identity:get_user(user_id=93bf552d7cee4eb2a435012967231c97)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:50.485387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:50.486981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 583/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/users/93bf552d7cee4eb2a435012967231c97 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:50.492967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:50.508610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:50.590899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513dd8e-d710-4ccd-b695-adcdbee4cfaa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:50.623369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:50.623972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:50.624253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:50.624525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:50.688993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:50.690436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:50.705311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:50.787121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 561/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:50.793161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:50.886865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cd89-14b7-41db-a833-4c415ffa1a4a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:50.918693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:50.919311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:50.919586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:50.919854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] PATH_INFO: `/v3/projects/8bac45426d9e4b078e86a7920c9828eb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:50.921004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] RBAC: Authorizing `identity:get_project(project_id=8bac45426d9e4b078e86a7920c9828eb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:50.922404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4439-3e2f-46eb-962c-6ff9b1374dae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:50.923994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 584/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/projects/8bac45426d9e4b078e86a7920c9828eb => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:50.929970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:51.026199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78012d57-baeb-4f53-9d73-9ae217253e01 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:51.039710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:51.060026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:51.060635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:51.060913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:51.061214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:51.061989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=8bac45426d9e4b078e86a7920c9828eb, user.id=93bf552d7cee4eb2a435012967231c97) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:51.062297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:51.063707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af431eb4-832a-42af-87cb-d0b0fb6f7384 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:51.069516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 562/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:50 2022] GET /identity/v3/role_assignments?user.id=93bf552d7cee4eb2a435012967231c97&scope.project.id=8bac45426d9e4b078e86a7920c9828eb&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:53.039605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1b6a7-ad49-4f5b-8015-9067b9694a30 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.040101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1b6a7-ad49-4f5b-8015-9067b9694a30 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.040101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1b6a7-ad49-4f5b-8015-9067b9694a30 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.041533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 585/1147] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:53.046656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.047055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.047201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.065635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:53.066844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:53.132881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 563/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:53.154405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1b6a7-ad49-4f5b-8015-9067b9694a30 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:53.158111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:53.253178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1b6a7-ad49-4f5b-8015-9067b9694a30 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:53.286472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:53.287021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.287299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.287567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.297295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:53.302262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:53.303330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:53.309175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 586/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:53.310041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:53.404696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9bb8-a73d-4811-9d97-509044e6f50b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:53.414119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:53.438451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:53.439056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.439333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.439602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.440298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:53.440594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:53.442013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:53.449849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 564/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:53.455617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:53.516620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:53.553892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb401c-3206-464a-a5e2-fa5e3ad4664a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:53.586298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:53.586924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.587207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.587483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] PATH_INFO: `/v3/users/93bf552d7cee4eb2a435012967231c97` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.588898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] RBAC: Authorizing `identity:get_user(user_id=93bf552d7cee4eb2a435012967231c97)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:53.590345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:53.591911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 587/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:53 2022] GET /identity/v3/users/93bf552d7cee4eb2a435012967231c97 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:53.597570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:53.693985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80323-faf3-43a2-a49f-ae93d8fd03b1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:53.726874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:53.727503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.727778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.728048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] PATH_INFO: `/v3/projects/8bac45426d9e4b078e86a7920c9828eb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.729197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] RBAC: Authorizing `identity:get_project(project_id=8bac45426d9e4b078e86a7920c9828eb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:53.730615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f0cd7-fe95-4da0-af2b-e3f15d0a8131 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:53.732244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 565/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:53 2022] GET /identity/v3/projects/8bac45426d9e4b078e86a7920c9828eb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:53.738096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:53.834359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3bb8-11be-4f99-a1a2-8b7814e92521 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:53.862312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:53.867760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:53.868425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:53.868707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:53.869005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] PATH_INFO: `/v3/projects/8bac45426d9e4b078e86a7920c9828eb/users/93bf552d7cee4eb2a435012967231c97/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:53.870947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bac45426d9e4b078e86a7920c9828eb, user_id=93bf552d7cee4eb2a435012967231c97, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:53.872367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acd8e3-0bbf-454a-b149-b2677d853634 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:53.885317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 588/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:44:53 2022] PUT /identity/v3/projects/8bac45426d9e4b078e86a7920c9828eb/users/93bf552d7cee4eb2a435012967231c97/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:44:55.925854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525592d-12ed-4703-b129-59141ef1ca39 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:55.926908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525592d-12ed-4703-b129-59141ef1ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:55.926908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525592d-12ed-4703-b129-59141ef1ca39 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:55.928260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 566/1154] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:55.934517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:55.934517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:55.934517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:55.952683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:55.953788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:56.024775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 589/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:56.051723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525592d-12ed-4703-b129-59141ef1ca39 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:56.099472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:56.169124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525592d-12ed-4703-b129-59141ef1ca39 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:56.213257 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:56.214952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:56.215230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:56.215497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:56.227093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:44:56.238461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:56.239641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:44:56.240875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 567/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:56.246119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:56.350952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c9ed-773f-461b-81ed-cffadfc747e5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:56.372810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:56.384627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:56.385282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:56.385561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:56.385831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:56.386533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:56.386831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:56.388193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:56.396555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 590/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:56.402363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:56.496251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:56.500323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78f99d-7f7c-4d49-9700-b3ceffca4c8b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:56.533197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:56.533828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:56.534105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:56.534375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] PATH_INFO: `/v3/users/93bf552d7cee4eb2a435012967231c97` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:56.535620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] RBAC: Authorizing `identity:get_user(user_id=93bf552d7cee4eb2a435012967231c97)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:56.537076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:56.538685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 568/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/users/93bf552d7cee4eb2a435012967231c97 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:56.545107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:56.642170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f514-da1d-4e84-9e51-31505ab5097f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:56.676193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:56.676815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:56.677128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:56.677400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:56.730513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:56.745643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:56.747144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:56.840694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 591/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:56.846721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:56.942248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd0940-64ab-4e3a-91ff-e5f8a3be9c08 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:56.975268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:56.975883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:56.976156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:56.976426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] PATH_INFO: `/v3/projects/8bac45426d9e4b078e86a7920c9828eb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:56.977573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] RBAC: Authorizing `identity:get_project(project_id=8bac45426d9e4b078e86a7920c9828eb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:56.978989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478281e-c322-4cc8-b93f-94ec08d2e979 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:56.980593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 569/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/projects/8bac45426d9e4b078e86a7920c9828eb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:56.986610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:57.065663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:57.080767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870e42-f91c-469d-8436-1e817eba8541 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:57.113782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:57.114403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:57.114682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:57.114956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:57.115732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=8bac45426d9e4b078e86a7920c9828eb, user.id=93bf552d7cee4eb2a435012967231c97) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:57.116038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:57.117467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34387c-fb75-422a-aa6b-a9515b711f54 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:57.122936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 592/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:44:56 2022] GET /identity/v3/role_assignments?user.id=93bf552d7cee4eb2a435012967231c97&scope.project.id=8bac45426d9e4b078e86a7920c9828eb&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:44:59.126412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e96b2-1723-4c4c-b2de-7d81253b83cb None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:59.126996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e96b2-1723-4c4c-b2de-7d81253b83cb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:59.126996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e96b2-1723-4c4c-b2de-7d81253b83cb None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:59.128304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 570/1162] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:44:59.134377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:59.134749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:59.134960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:59.154174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:44:59.155341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:44:59.219510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 593/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:44:59.241753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e96b2-1723-4c4c-b2de-7d81253b83cb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:59.276733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:59.342278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e96b2-1723-4c4c-b2de-7d81253b83cb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:59.374420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:59.375023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:59.375303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:59.375577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:59.440307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:59.442467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:59.473442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:59.537185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 571/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:44:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:44:59.543161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:59.618092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:59.638722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460ede8-a4e8-4791-9a61-3d766e111834 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:59.671681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:59.672308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:59.672582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:59.672847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:59.682543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:59.683969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a5828e09-3464-4062-84e3-3c81644cd69a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:44:59.695245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:44:59.696449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:44:59.697346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 594/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:44:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:44:59.702370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:44:59.799480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4dbf-bcdf-4d3b-bed7-a42c27dcdda2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:44:59.832513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:44:59.833144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:44:59.833419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:44:59.833684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:44:59.834358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:44:59.834654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:44:59.835998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09ef83-2eca-4904-a739-0e6ce3f1bf41 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:44:59.837385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:44:59.844147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 572/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 06:44:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:01.794183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66bdd-f191-4554-a71f-5be34a3b0847 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:01.794687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66bdd-f191-4554-a71f-5be34a3b0847 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:01.794786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66bdd-f191-4554-a71f-5be34a3b0847 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:01.796033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 595/1167] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:01.801221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363e47-fd22-4a4f-aeea-5ba2522f0abe None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:01.801583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363e47-fd22-4a4f-aeea-5ba2522f0abe None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:01.801789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363e47-fd22-4a4f-aeea-5ba2522f0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:01.820030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d1363e47-fd22-4a4f-aeea-5ba2522f0abe None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:01.821243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1363e47-fd22-4a4f-aeea-5ba2522f0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:01.886835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 573/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:01.910143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66bdd-f191-4554-a71f-5be34a3b0847 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:02.005909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66bdd-f191-4554-a71f-5be34a3b0847 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:02.037841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:02.038439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:02.038714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:02.038980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:02.039667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:02.041019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa95ee3-6dd4-403c-bbdd-b50b7dffb6f4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:02.049714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:02.061001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 596/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Aug 4 06:45:01 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:45:04.051640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a832-d39b-4b78-b837-4319be395d82 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:04.052139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a832-d39b-4b78-b837-4319be395d82 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:04.052139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a832-d39b-4b78-b837-4319be395d82 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:04.053482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 574/1170] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:04.058539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:04.058957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:04.059088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:04.076461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:04.077658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:04.141808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 597/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:04.165381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a832-d39b-4b78-b837-4319be395d82 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:04.264037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a832-d39b-4b78-b837-4319be395d82 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:04.289711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:04.297364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:04.297987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:04.298262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:04.298531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] PATH_INFO: `/v3/domains/7c7c0f9a5dbe4fa7ba52bfb435705a76` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:04.309229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c7c0f9a5dbe4fa7ba52bfb435705a76)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:04.310662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe939-69a9-48cf-8019-729973257dd7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:04.312236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 575/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Aug 4 06:45:04 2022] GET /identity/v3/domains/7c7c0f9a5dbe4fa7ba52bfb435705a76 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:04.318096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:04.411564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8645b-786d-47a0-a49a-44f832d5a89d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:04.436204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:04.444642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:04.445277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:04.445556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:04.445826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:04.446500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:04.447901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f4d88-ef3a-47fb-afbb-3b040cad0ee7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:04.473560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 598/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:45:04 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:45:06.488604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8974e-5118-4872-a8d4-b1d111fca180 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:06.489218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8974e-5118-4872-a8d4-b1d111fca180 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:06.489218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8974e-5118-4872-a8d4-b1d111fca180 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:06.490540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 576/1174] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:06.495608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:06.495992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:06.496156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:06.514190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:06.515354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:06.578431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 599/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:06.603384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8974e-5118-4872-a8d4-b1d111fca180 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:06.703439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8974e-5118-4872-a8d4-b1d111fca180 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:06.736552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:06.737204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:06.737482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:06.738286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] PATH_INFO: `/v3/domains/7c7c0f9a5dbe4fa7ba52bfb435705a76` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:06.739492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c7c0f9a5dbe4fa7ba52bfb435705a76)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:06.740865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1d3ea-5b96-4b24-8c3b-b9c568d7b5eb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:06.742462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 577/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Aug 4 06:45:06 2022] GET /identity/v3/domains/7c7c0f9a5dbe4fa7ba52bfb435705a76 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:06.748248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:06.841621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc90f4-5f78-4721-9347-9d6bfa684da6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:06.851647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:06.874595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:06.875198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:06.875481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:06.875750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:06.876419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:06.877859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c473-edbd-41a6-9faa-bda37e5d672f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:06.898554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 600/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:45:06 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:45:08.926139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e368-ba53-4cc9-b7ac-7fd2acd31d40 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:08.926690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e368-ba53-4cc9-b7ac-7fd2acd31d40 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:08.926690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e368-ba53-4cc9-b7ac-7fd2acd31d40 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:08.928034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 578/1178] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:08.933320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:08.933727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:08.933866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:08.952611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:08.953731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:09.018547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 601/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:09.041102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e368-ba53-4cc9-b7ac-7fd2acd31d40 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:09.097468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:09.141642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e368-ba53-4cc9-b7ac-7fd2acd31d40 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:09.173619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:09.174247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:09.174524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:09.174796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:09.185437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:45:09.190288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:45:09.191615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:45:09.192544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 579/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:45:09.197569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:09.296590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:09.303751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731927d4-4ec4-4469-8131-5631204bd508 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:09.336788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:09.337438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:09.337721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:09.337993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:09.338949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:45:09.339252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:09.340629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:09.348954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 602/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:09.354787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:09.459207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86957-44aa-4c2c-a0c6-47b13fd51dc9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:09.474627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:09.492084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:09.492707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:09.493005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:09.493275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] PATH_INFO: `/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:09.506267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fbe5a9df4cccb3b686d1d8ae45ba)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:09.507688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:09.509296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 580/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:09.515132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:09.608640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f7270-3659-42d0-bd21-e721e5979442 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:09.640967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:09.641626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:09.641906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:09.642176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:09.668438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:09.710631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:09.712073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:09.805618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 603/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:45:09.811591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:09.909009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f6cc-8e17-4300-9796-95fe24db05fc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:09.942188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:09.942812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:09.943090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:09.943359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] PATH_INFO: `/v3/projects/ea4beb0e444a4ada8254197f28b71237` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:09.944507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] RBAC: Authorizing `identity:get_project(project_id=ea4beb0e444a4ada8254197f28b71237)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:09.945956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4a7e-bf6d-4d1b-8577-d49e2f7b142f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:09.948036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 581/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/projects/ea4beb0e444a4ada8254197f28b71237 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:09.954004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:10.010622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:10.050866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b30b9-5865-4e7b-b114-70ec048f5f6c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:10.083368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:10.083977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:10.084260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:10.084536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:10.085339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=ea4beb0e444a4ada8254197f28b71237, user.id=68d5fbe5a9df4cccb3b686d1d8ae45ba) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:45:10.085650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:10.087074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49316-3e4f-432b-a2cc-179961e877c2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:10.092509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 604/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:45:09 2022] GET /identity/v3/role_assignments?user.id=68d5fbe5a9df4cccb3b686d1d8ae45ba&scope.project.id=ea4beb0e444a4ada8254197f28b71237&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:12.049705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add89a3-c0e3-4fc9-83ac-296bc4d04101 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.050912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add89a3-c0e3-4fc9-83ac-296bc4d04101 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.050912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add89a3-c0e3-4fc9-83ac-296bc4d04101 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.051995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 582/1186] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:12.057057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.057488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.057594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.076064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:12.077287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:12.141708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 605/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:12.163174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add89a3-c0e3-4fc9-83ac-296bc4d04101 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:12.206720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:12.262238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add89a3-c0e3-4fc9-83ac-296bc4d04101 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:12.294154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:12.294771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.295043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.295311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.305707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:45:12.310442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:45:12.311638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:45:12.312557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 583/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:45:12.318245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:12.369972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:12.414953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42601728-6f05-41f5-9f68-d594609d18ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:12.451520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:12.452131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.452412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.452687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.453424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:45:12.453735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:12.455090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:12.462864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 606/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:12.469116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:12.564439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e4277-82e9-4e6c-bcb8-ca10e5b0e351 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:12.566058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:12.598472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:12.599093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.599366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.599634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] PATH_INFO: `/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.600777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fbe5a9df4cccb3b686d1d8ae45ba)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:12.602218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:12.603777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 584/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:45:12 2022] GET /identity/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:12.609513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:12.707926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7560c-5d62-4df9-908f-c2c070230ceb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:12.727323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:12.747558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:12.748194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.748477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.748751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] PATH_INFO: `/v3/projects/ea4beb0e444a4ada8254197f28b71237` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.749927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4beb0e444a4ada8254197f28b71237)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:12.751510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e27a8-d985-4552-a7e1-2b36899529e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:12.753815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 607/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:45:12 2022] GET /identity/v3/projects/ea4beb0e444a4ada8254197f28b71237 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:12.759772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:12.855871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafe79f-e063-443f-90ad-b05d71062f38 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:12.889269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:12.889980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:12.890263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:12.890538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] PATH_INFO: `/v3/projects/ea4beb0e444a4ada8254197f28b71237/users/68d5fbe5a9df4cccb3b686d1d8ae45ba/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:12.892455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4beb0e444a4ada8254197f28b71237, user_id=68d5fbe5a9df4cccb3b686d1d8ae45ba, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:12.893961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bd51f-a755-4c00-b7a2-ffebd2bf7e21 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:12.906265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 585/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:45:12 2022] PUT /identity/v3/projects/ea4beb0e444a4ada8254197f28b71237/users/68d5fbe5a9df4cccb3b686d1d8ae45ba/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:45:14.867464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b985a-fe2d-4f04-aded-09efe33d0b9c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:14.868004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b985a-fe2d-4f04-aded-09efe33d0b9c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:14.868004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b985a-fe2d-4f04-aded-09efe33d0b9c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:14.869362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 608/1193] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:45:14.874518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:14.874892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:14.875062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:14.893219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:45:14.895054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:45:14.917864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:14.961523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 586/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:45:14.984514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b985a-fe2d-4f04-aded-09efe33d0b9c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.085044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b985a-fe2d-4f04-aded-09efe33d0b9c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.118084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.118711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.118991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.119265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.129499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:45:15.134321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:45:15.135416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:45:15.136456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 609/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:45:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:45:15.141414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.236110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd6e2d-67d0-4d8b-a133-e966d5f6828b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.268050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.269187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.269636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.269908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.270604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:45:15.270901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:15.272246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:15.279938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 587/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:45:15.286234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.327296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:15.384286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702f465-b4c3-4a7c-9b5e-456c00ace110 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.417215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.417850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.418131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.418406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] PATH_INFO: `/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.419559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] RBAC: Authorizing `identity:get_user(user_id=68d5fbe5a9df4cccb3b686d1d8ae45ba)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:15.420971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:15.422578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 610/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 06:45:15 2022] GET /identity/v3/users/68d5fbe5a9df4cccb3b686d1d8ae45ba => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:15.428735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.453568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:15.526806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bff9c-ff6f-458f-a527-9268df5759cd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.558299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.558898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.559170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.559436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.624007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:15.625470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:15.648325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:15.722742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 588/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:45:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:45:15.728739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.823621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a51e-b1c5-4871-83bf-ffe701c0a43a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.833503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:15.856006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.856631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.856908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.857204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] PATH_INFO: `/v3/projects/ea4beb0e444a4ada8254197f28b71237` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.858334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4beb0e444a4ada8254197f28b71237)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:15.859737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66211c94-aa2a-4083-b897-d681d25c6717 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:15.861379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 611/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 06:45:15 2022] GET /identity/v3/projects/ea4beb0e444a4ada8254197f28b71237 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:15.868063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:45:15.964143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99305-3340-4686-949f-ae1e4f36366c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:45:15.985831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:15.997756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:45:15.998370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:45:15.998649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:45:15.998924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:45:15.999698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=ea4beb0e444a4ada8254197f28b71237, user.id=68d5fbe5a9df4cccb3b686d1d8ae45ba) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:45:16.000006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:45:16.001471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeb672-1aa3-4f9f-8509-aabce8f372ac None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:45:16.007641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 589/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:45:15 2022] GET /identity/v3/role_assignments?user.id=68d5fbe5a9df4cccb3b686d1d8ae45ba&scope.project.id=ea4beb0e444a4ada8254197f28b71237&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:45:25.852043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:45:26.005224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:11.103640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148e7e-6506-45d1-acfa-2f12db1d3250 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:11.103640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148e7e-6506-45d1-acfa-2f12db1d3250 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:11.103640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148e7e-6506-45d1-acfa-2f12db1d3250 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:11.104698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 612/1201] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:11.113042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:11.113042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:11.113042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:11.143228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:11.144423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:11.253031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 590/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:11.279424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148e7e-6506-45d1-acfa-2f12db1d3250 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:11.428565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef148e7e-6506-45d1-acfa-2f12db1d3250 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:11.469844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:11.470502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:11.470801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:11.471048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:11.482114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:11.484088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:11.502648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:11.504092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:11.505315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:11.505315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:11.505315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:11.505315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:11.509008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 613/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:11.510512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:11.643169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655c2d-7c57-46e8-9138-d2444c2555b1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:11.683607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:11.696722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:11.703784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:11.703784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:11.704645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:11.705244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:11.705662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:11.707376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea066331-d4b0-4998-b6f1-3f855fc8a3d0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:11.725028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 591/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:11.730345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:11.815075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:11.880775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0209ee-6866-43bd-bf26-8d7fafd9070d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:11.924421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:11.925232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:11.925541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:11.925814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:11.926648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:11.926648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96a745-0226-492d-9f31-3a7f3a4c95a2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:11.956201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 614/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 06:46:11 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:46:14.331607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156c70-db3d-4c41-b556-a0c1cd617bdf None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:14.332166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156c70-db3d-4c41-b556-a0c1cd617bdf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:14.332166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156c70-db3d-4c41-b556-a0c1cd617bdf None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:14.333729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 592/1206] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:14.339399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:14.339812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:14.339989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:14.359817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:14.361020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:14.443720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 615/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:14.467564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156c70-db3d-4c41-b556-a0c1cd617bdf None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:14.583471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156c70-db3d-4c41-b556-a0c1cd617bdf None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:14.620225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:14.620645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:14.620899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:14.621199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:14.633751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:14.638665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:14.639990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:14.641100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:14.645148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 593/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:46:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:14.646579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:14.703165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:14.765651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1bf5a-322b-4662-b713-85bf63b7600c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:14.804513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:14.805177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:14.805456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:14.805737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:14.806446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:14.806750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:14.808200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:14.816828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 616/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:14.822749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:14.880254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:14.935575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e4bd9-0bea-43ea-ba73-bc98ffa366ee None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:14.974925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:14.975565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:14.975899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:14.976120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:14.987390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:14.988838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:15.003698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:15.004817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:15.010830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:15.010830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:15.010830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:15.010830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:15.010830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 594/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:15.011836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:15.118899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:15.121775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949afa06-577d-4941-8ff8-34a8efbb0b24 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:15.162494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:15.163106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:15.163384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:15.163655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:15.164351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:15.164665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:15.166070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:15.179530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 617/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:15.185735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:15.305650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93726-36b7-4dc7-8948-75b50f4da5da None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:15.308402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:15.346132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:15.346858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:15.347086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:15.347348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:15.356371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:15.357918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:15.370011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:15.371293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:15.372447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 595/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:15.377674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:15.491583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d2853-6114-4c65-a98c-7c41d02cf081 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:15.531949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:15.532579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:15.532861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:15.533205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:15.533995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:15.534298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:15.535721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:15.558729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 618/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:15.561064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:15.672043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388f6-8a2b-460f-81f9-efb6ed054927 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:15.711208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:15.712186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:15.712565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:15.712897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:15.744547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:15.787871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:15.789738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:15.920092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 596/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:46:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:46:15.926381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:15.946768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:16.045677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a53c4-6aec-49fa-b3a9-4ed9c761a17c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:16.086783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:16.087539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:16.087892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:16.088240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:16.100706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:16.102551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:16.120389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:16.121564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:16.122656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:16.122656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:16.122656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:16.122656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:16.128173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 619/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:16.129655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:16.205594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:16.257543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574d7f-51b4-4acb-9140-14383379541c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:16.305929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:16.306830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:16.307108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:16.307379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:16.308071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:16.308371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:16.309884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:16.324851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 597/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:46:16.331655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:16.416308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:16.460750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618c4fb-dc71-4896-91bc-20fbc6fb4f20 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:16.500645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:16.501708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:16.502206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:16.502734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:16.510518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:16.512069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:16.523774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:16.524973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:16.526125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:16.527579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 620/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:16.533568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:16.641955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7b7b0-fa3e-4789-913b-84359ae821aa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:16.681399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:16.701668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:16.702606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:16.702993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:16.703295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:16.704119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:16.704430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:16.706373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7705c7-c172-4801-8171-972b6d922882 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:16.722689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 598/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:16.730383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:16.848063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605281b1-943d-48a0-abe3-2afff1dc94c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:16.878718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:16.885993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:16.886605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:16.886878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:16.887144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:16.887925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=11759ed684c74cadada92aef1f6d0e40) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:16.888224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:16.890234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137fe79-d31d-4f81-afc7-2331f18623d8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:16.905108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 621/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:46:16 2022] GET /identity/v3/role_assignments?user.id=11759ed684c74cadada92aef1f6d0e40&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:19.069886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0479a-ffbf-4aa1-b273-a073a2dd0fa3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.070429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0479a-ffbf-4aa1-b273-a073a2dd0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.070541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0479a-ffbf-4aa1-b273-a073a2dd0fa3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.071803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 599/1220] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:19.077741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.078156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.078290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.098703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:19.100088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:19.172741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 622/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:19.195870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0479a-ffbf-4aa1-b273-a073a2dd0fa3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:19.307512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0479a-ffbf-4aa1-b273-a073a2dd0fa3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:19.345345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:19.345920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.346200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.346473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.356378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:19.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:19.362782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:19.363725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 600/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:19.369374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:19.478440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24f27b-e565-4269-96ff-dce3e4a2abd0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:19.504463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:19.517159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:19.517785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.518066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.518340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.519058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:19.519358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:19.520729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:19.529391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 623/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:19.535802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:19.582307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:19.642060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c074c45-b97f-45a8-880b-003b6d6c3c38 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:19.677193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:19.678008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.678316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.678594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.689012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:19.690436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:19.707691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:19.708814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:19.714914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:19.714914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:19.714914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:19.714914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:19.714914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 601/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:19.715255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:19.817495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c18b-5979-4251-9ae2-ce2d2da0a425 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:19.852170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:19.852783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:19.853092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:19.853364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:19.854037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:19.854333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:19.855667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:19.866898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 624/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:46:19.872561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:19.975239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:19.981561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa498c-42c2-4604-a885-bb8afeb14e8a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.020555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.021261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.022087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.022419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.030642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.032181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:20.044876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:20.046346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:20.053150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 602/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:20.053833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:20.104169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:20.163247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa92f-f5bd-4d1c-9341-70f64f4e11f7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.200264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.200894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.201230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.201509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.203203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:20.203535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.204967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.223623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 625/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:20.229568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:20.340339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47024a-25a0-4c06-98f8-0351b662cf44 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.377138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.377792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.378077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.378409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.391601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.393124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:20.410677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:20.411815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:20.412942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:20.412942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:20.412942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:20.412942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:20.412942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 603/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:20.419343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:20.528721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c923e78-b31a-4279-ad7c-14ffcd8b2620 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.531122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:20.567671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.568342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.568647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.568915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.569688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:20.570056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.571475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.585407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 626/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:20.591606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:20.602527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:20.707090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f383f4-090c-4551-a655-2aaeeab693ad None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.743520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.744136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.744483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.744686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.751532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.752964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:20.764372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:20.765798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:20.766697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 604/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:20.771808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:20.879981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9f6d-1370-4847-8146-59abe5b60dee None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:20.916834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:20.917456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:20.917729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:20.918001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:20.918733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:20.919424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:20.920585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d468c1-960a-44d2-afd6-10be5495fb1f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:20.938614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 627/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:20.940345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:21.011640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:21.050197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dcd63-f103-4240-9cb8-48040d94ce18 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:21.088210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:21.088938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:21.089258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:21.089526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/11759ed684c74cadada92aef1f6d0e40/roles/f4b8b364c004415d8a003f910cb65caf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:21.105623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=11759ed684c74cadada92aef1f6d0e40, role_id=f4b8b364c004415d8a003f910cb65caf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:21.107061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36420-e5ed-446b-8141-0af785b6dd26 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:21.127379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 605/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:46:20 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/11759ed684c74cadada92aef1f6d0e40/roles/f4b8b364c004415d8a003f910cb65caf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:46:23.127862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c29dc-40b6-428a-a52f-9543fe21413a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.128409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c29dc-40b6-428a-a52f-9543fe21413a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.128496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c29dc-40b6-428a-a52f-9543fe21413a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.129817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 628/1233] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:23.135155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.135555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.135698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.154381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:23.155611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:23.221922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 606/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:23.248014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c29dc-40b6-428a-a52f-9543fe21413a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:23.274466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:23.354899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c29dc-40b6-428a-a52f-9543fe21413a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:23.392722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:23.393340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.393677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.393936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.406783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:23.412892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:23.414076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 06:46:23.415108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:23.421554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 629/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 06:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:23.422513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:23.469737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:23.526563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e39f3-dbc0-4e8e-949e-f9bfe6080fc4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:23.563528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:23.564163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.564438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.564717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.565462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:23.565803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:23.567683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:23.577483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 607/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 06:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:23.584070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:23.680010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:23.694893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2febc8-beea-4bed-b453-60d908710e8d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:23.733356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:23.733988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.734263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.734533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.746061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:23.747506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:23.762561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:23.763513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:23.765040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:23.765040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:23.765040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:23.765040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:23.765040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 630/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:23.770308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:23.874476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397d0f-5acd-4ae1-ab84-7112894dfa26 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:23.883404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:23.909736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:23.910348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:23.910596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:23.910869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:23.911552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:23.911853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:23.913266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:23.925366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 608/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:23.931618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:24.040042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc134d-d1f3-49b4-aadd-33b2a5b88f11 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:24.074198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:24.074818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:24.075106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:24.075361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:24.079157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:24.084711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:24.086660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:24.098067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:24.099254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:24.100569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 631/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:24.105094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:24.207402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a11577-3dff-469f-9f5f-6141c923b18f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:24.242760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:24.243379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:24.243651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:24.243917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:24.244694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:24.245022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:24.246445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:24.265128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 609/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:24.271056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:24.377409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9f1e5-644e-47d6-9cb0-70e82fffc6dc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:24.420008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:24.421232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:24.421515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:24.421788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:24.490304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:24.497579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:24.499241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:24.612319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 632/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:46:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:46:24.613586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:24.644841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:24.728062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ec62-d059-455e-8232-8c517ce112a6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:24.767413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:24.768160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:24.768436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:24.768752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:24.780814 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:24.782413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:24.799907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:24.801196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:24.807244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:24.807244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:24.807244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:24.807244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:24.807244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 610/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:24.807626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:24.910235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:24.917953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00ca0-3e5d-4e8a-aefe-1db117be6d7b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:24.954549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:24.955174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:24.955482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:24.955752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:24.956435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:24.956755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:24.958148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:24.970907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 633/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:24.977085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:25.062626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:25.087759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c744-5327-46cf-a06a-a62eb9d7a4cd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:25.126297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:25.126944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:25.127228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:25.127484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:25.134204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:25.135619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:25.146845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:25.148000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:25.148928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 611/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:25.154020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:25.260713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e1fa6-7867-4b4b-92f9-0ee10000447a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:25.297664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:25.298304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:25.298626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:25.298902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:25.299643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:25.299945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:25.301535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946324-7e5d-4e79-8733-46e1be89b9f0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:25.314941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 634/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:25.321253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:25.431727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b467b-e5e2-4711-b90c-40f5aeffd1b4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:25.468873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:25.469571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:25.469874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:25.470213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:25.471046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] RBAC: Adding query filter params (role.id=f4b8b364c004415d8a003f910cb65caf, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=11759ed684c74cadada92aef1f6d0e40) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:25.471353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:25.472767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22e405-fe72-41dc-b20e-3b0c98bf99a3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:25.479147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 612/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:46:25 2022] GET /identity/v3/role_assignments?user.id=11759ed684c74cadada92aef1f6d0e40&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=f4b8b364c004415d8a003f910cb65caf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:27.640467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717428-b9ef-40cf-bbdf-3d81e7aff3c2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:27.641059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717428-b9ef-40cf-bbdf-3d81e7aff3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:27.641059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717428-b9ef-40cf-bbdf-3d81e7aff3c2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:27.642324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 635/1247] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:27.649085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:27.649534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:27.649636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:27.656931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:27.671415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:27.672604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:27.749070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 613/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:27.775987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717428-b9ef-40cf-bbdf-3d81e7aff3c2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:27.796878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:27.896746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717428-b9ef-40cf-bbdf-3d81e7aff3c2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:27.932893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:27.933590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:27.933873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:27.934144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:27.945940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:27.950970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:27.952737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:27.953803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:27.957894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 636/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:27.959014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.072089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca333-94c8-4398-9816-c878dcc73f2f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:28.103630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:28.110385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:28.111045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:28.111321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:28.111590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:28.112344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:28.112645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:28.114128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:28.122744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 614/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:28.128806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.212686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:28.238041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6840-9112-4010-8233-e64e6f7741a2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:28.276022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:28.276642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:28.276918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:28.277233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:28.289109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:28.290548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:28.307804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:28.309069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:28.310175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:28.310175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:28.310175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:28.310175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:28.310175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 637/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:28.316893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.445388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8a76-296d-4ffe-8098-6b9a6d8e0c39 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:28.482916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:28.483463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:28.483738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:28.484052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:28.484741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:28.485078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:28.486458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:28.501068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 615/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:28.504515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.608965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07756-bd22-4d79-a887-7cf545742eac None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:28.635729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:28.646066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:28.646857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:28.647093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:28.647454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:28.656529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:28.657982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:28.669754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:28.671026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:28.672181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 638/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:28.681133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.745420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:28.798271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5023-a72c-4d4d-90a4-81066860ee69 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:28.835561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:28.836485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:28.836760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:28.837063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:28.837853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:28.838153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:28.839580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:28.860792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 616/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:28.866527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:28.972078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f401ed-a6d6-4ffe-a008-2a614cd6c903 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:29.008479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:29.009088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:29.009407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:29.009739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:29.068444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:29.082111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:29.083582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:29.188166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 639/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:46:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:46:29.194143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:29.302641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cadb0-af51-4cc7-9480-d0aad4522835 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:29.317083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:29.339172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:29.339876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:29.340090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:29.340346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:29.351566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:29.353284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:29.368599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:29.369664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:29.370602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:29.370602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:29.370602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:29.370602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:29.370602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 617/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:29.375554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:29.474572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:29.487509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc64c7a-4af7-4a8a-9553-7f5b9156f74f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:29.523788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:29.524448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:29.524725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:29.525007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:29.525704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:29.526052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:29.527362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:29.539055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 640/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:29.545041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:29.647681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5bc9-013a-4c5a-a7b7-b141ffde817e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:29.682338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:29.682969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:29.683258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:29.683516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:29.691296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:29.692769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:29.705785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:29.706736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:29.707641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 618/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 06:46:29.713281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:29.816160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc552-4511-4b60-8979-27e9faaaa8ed None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:29.853414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:29.854030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:29.854306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:29.854569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:29.855310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:29.855597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:29.857018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c49175-3a7b-4a76-9b86-6bbce8b109ef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:29.869975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 641/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:29.876346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:29.901591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:29.980637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c132-adf3-49b8-9d91-809903e2ba3d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:30.028615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:30.030620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:30.030967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:30.031317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:30.032306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=11759ed684c74cadada92aef1f6d0e40) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:30.032658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:30.034389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeb956-bc62-4075-b4aa-d3529d3e0c13 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:30.040418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 619/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:46:29 2022] GET /identity/v3/role_assignments?user.id=11759ed684c74cadada92aef1f6d0e40&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:32.034977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448387-bef7-49e9-b146-df08b3a65c33 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.035487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448387-bef7-49e9-b146-df08b3a65c33 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.035487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448387-bef7-49e9-b146-df08b3a65c33 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.036811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 642/1261] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:32.042011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.042443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.042562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.061190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:32.062363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:32.127611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 620/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:32.149857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448387-bef7-49e9-b146-df08b3a65c33 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:32.161333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:32.247786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448387-bef7-49e9-b146-df08b3a65c33 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:32.280486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:32.281136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.281414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.281682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.291202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:32.296475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:32.297634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:32.298496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 643/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:32.303599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:32.321818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:32.404586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9366545-7b3e-488f-b20d-4766003b5876 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:32.441846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:32.442457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.442735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.443010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.443716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:32.444019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:32.445411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:32.453683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 621/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:32.459917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:32.524648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:32.556998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819038b5-e672-4bea-9282-3fc16a4c4789 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:32.590003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:32.590626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.590906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.591182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.601653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:32.603073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:32.617913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:32.618973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:32.620168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:32.620168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:32.620168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:32.620168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:32.620168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 644/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:32.625049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:32.704307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:32.723715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297749c7-5815-42e0-a2e1-facddda212a7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:32.756121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:32.756721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.757017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.757292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.757967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:32.758263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:32.759615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:32.770863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 622/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:32.776643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:32.871907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150d02-4e3e-4e9f-ba98-c3b9a2f73a9e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:32.890350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:32.903769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:32.904951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:32.905257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:32.905526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:32.913499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:32.914936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:32.926561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:32.927668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:32.929030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 645/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:32.933522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.030358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761f3f6-fa54-41a9-aeee-8d75378cb023 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.062622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.063221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.063494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.063761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.064527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:33.064826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.066270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.074562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:33.084072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 623/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:33.090013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.186011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adca7d-95df-4f0d-9fc8-e1911f6e4cda None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.218493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.219108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.219389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.219665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.229696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.231115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:33.245931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:33.246985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:33.248657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:33.248657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:33.248657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:33.248657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:33.248657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 646/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:33.253353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.349452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee5a5c-aa07-4d1d-9b72-271385f8f642 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.382509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.383215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.383566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.383867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.384692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:33.385033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.386627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.399936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 624/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:33.406515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.438038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:33.503094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef0ad5-c180-4d90-a1b6-44a7d07e8af8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.534539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.535160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.535439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.535708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.542215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.543663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:33.555538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:33.556565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:33.557674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 647/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:33.562965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.620847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:33.662347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52639-32c0-4ef9-b056-9357e817cd39 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.695398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.695942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.696218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.696490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.697252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:33.697556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.698977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49c66-a2ea-4e98-8492-f5914225f203 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.712262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 625/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:33.719077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:33.806111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:33.815026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd75f1-7d51-4d2f-86cc-4bd8546193e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:33.847700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:33.848347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:33.848622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:33.848890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] PATH_INFO: `/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/11759ed684c74cadada92aef1f6d0e40/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:33.850821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user_id=11759ed684c74cadada92aef1f6d0e40, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:33.852223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715861-9381-40c8-abb7-88f338ec9c6c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:33.864254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 648/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 06:46:33 2022] PUT /identity/v3/projects/c7a34838e7a54fdcbcb3c4ba4b0d37b3/users/11759ed684c74cadada92aef1f6d0e40/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:46:35.835693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e93d-1a0f-4d3b-b9a7-301059a1f839 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:35.836467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e93d-1a0f-4d3b-b9a7-301059a1f839 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:35.836558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e93d-1a0f-4d3b-b9a7-301059a1f839 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:35.837900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 626/1274] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:35.843557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:35.843971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:35.844101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:35.862089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:35.863258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:35.927076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 649/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:35.950280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593e93d-1a0f-4d3b-b9a7-301059a1f839 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.052639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593e93d-1a0f-4d3b-b9a7-301059a1f839 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.074748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:36.093602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.094236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.094515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.094784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.104524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 06:46:36.109893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:36.110985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:36.112023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 627/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 06:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:36.117058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.193096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:36.211670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50626999-b1b0-4e02-8a47-c005914d7482 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.244396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.245026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.245308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.245580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.246282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:36.246583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:36.248052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:36.255669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 650/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:36.261306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.358809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c8f4-b910-463e-9ac8-6e09e2d97edd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.395555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.396277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.396627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.396905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.409668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:36.411375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:36.426080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:36.427137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:36.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:36.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:36.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:36.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:36.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 628/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:36.432944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.530502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eec73-9cce-4bb9-a631-90c4128e9482 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.562379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.562980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.563259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.563531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.564203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:36.564506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:36.565883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:36.577588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 651/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:36.583325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.614381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:36.682159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac4bd-3d56-47d5-9375-5fff99464910 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.716034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.716724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.717025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.717305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.724774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:36.726246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 06:46:36.737764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:36.738865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:36.739895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 629/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:36.744656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.749216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:36.841410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe89634-be9d-4d6e-9a01-45e447fe5923 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:36.874628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:36.875190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:36.875452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:36.875729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:36.876507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:36.876816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:36.878256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:36.894463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 652/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:36.900224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:36.989251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:36.999504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28988-6aab-44cd-8e3e-5bdadadfbe70 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.033136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.033739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.034015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.034287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.100830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.102304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.186629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:37.196536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 630/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 06:46:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 06:46:37.202432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:37.261279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:37.299358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abea91-ed26-4c41-983e-129f87e3c5ae None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.331455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.332079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.332357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.332628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.343272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.344688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 06:46:37.359194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:37.360271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:37.361290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 06:46:37.361290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 06:46:37.361290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 06:46:37.361290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:37.361290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 653/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:37.365965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:37.470095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc228-d1d5-40cc-8ac9-c0e943250a92 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.502386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.502995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.503281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.503557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.504234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:37.504538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.505933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.517412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 631/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 06:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:37.523165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:37.618636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e866-1262-4512-8d3f-88b26d8ad1b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.631503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:37.651487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.652111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.652393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.652665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.659623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.661078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 06:46:37.672809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:37.673874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: ERROR keystone.server.flask.application Aug 04 06:46:37.674808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 654/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 06:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:37.679909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:37.729400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:37.778222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69a21-7d2b-44eb-bc48-b3145454b8a4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.810280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.810889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.811163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.811430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.812158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:37.812460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.813892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472ed0-7089-4a5b-a653-3fb3805becc3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.826456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 632/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 06:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:37.832729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:37.927862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b491-3b12-46ef-af10-9b46a17d5cdd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:37.960288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:37.961162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:37.961441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:37.961710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:37.962478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] RBAC: Adding query filter params (role.id=caebc9bcf6f048af9c4ccff5ee4b50ac, scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3, user.id=11759ed684c74cadada92aef1f6d0e40) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:37.962786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:37.964195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5fac0-9023-4e06-a023-112f3e084314 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:37.969999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 655/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 06:46:37 2022] GET /identity/v3/role_assignments?user.id=11759ed684c74cadada92aef1f6d0e40&scope.project.id=c7a34838e7a54fdcbcb3c4ba4b0d37b3&role.id=caebc9bcf6f048af9c4ccff5ee4b50ac => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:39.981093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6368-96f0-4e54-acf6-811294c87605 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:39.981589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6368-96f0-4e54-acf6-811294c87605 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:39.981589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b6368-96f0-4e54-acf6-811294c87605 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:39.983122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 633/1288] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:39.988146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34859-b081-4433-9d17-25aae733611e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:39.988517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34859-b081-4433-9d17-25aae733611e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:39.988687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34859-b081-4433-9d17-25aae733611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:40.006240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-59a34859-b081-4433-9d17-25aae733611e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:40.007402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-59a34859-b081-4433-9d17-25aae733611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:40.036375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:40.072115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 656/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:46:40.094949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6368-96f0-4e54-acf6-811294c87605 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:40.193585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b6368-96f0-4e54-acf6-811294c87605 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:40.204289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:40.227410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:40.228040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:40.228311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:40.228579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:40.229213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:40.230560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:40.239178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:40.240473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:40.241682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 634/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:46:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:40.246246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34859-b081-4433-9d17-25aae733611e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:40.341355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34859-b081-4433-9d17-25aae733611e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:40.373726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:40.374332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:40.374610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:40.374882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:40.375549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:40.375851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:40.377235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e34c0b-5667-443b-ae03-a15e14f60eef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:40.382621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 657/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 06:46:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:40.389705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:40.498736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc034-5cda-4e1e-8308-cb8e2e7b198b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:40.531157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:40.531767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:40.532046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:40.532319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:40.533009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:40.533320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:40.534688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c41035-eae6-4152-9fe0-ccc366e902c5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:40.538982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 635/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 06:46:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:46:42.503715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1ffa-60bd-4169-a322-d5c7e9527fc5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:42.504374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1ffa-60bd-4169-a322-d5c7e9527fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:42.504374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1ffa-60bd-4169-a322-d5c7e9527fc5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:42.505634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 658/1293] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:42.510578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59554-9a06-4917-aa47-7c55a6d2a1fc None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:42.510972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59554-9a06-4917-aa47-7c55a6d2a1fc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:42.511120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59554-9a06-4917-aa47-7c55a6d2a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:42.529745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-62e59554-9a06-4917-aa47-7c55a6d2a1fc None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:42.530898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-62e59554-9a06-4917-aa47-7c55a6d2a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:42.559030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:42.596790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 636/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:42.618446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1ffa-60bd-4169-a322-d5c7e9527fc5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:42.648940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:42.720761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1ffa-60bd-4169-a322-d5c7e9527fc5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:42.754480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:42.755025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:42.755303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:42.755576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:42.756263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:42.757649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b380-6591-4cfc-a311-28f7595e38bd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:42.771407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 659/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 06:46:42 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:46:44.779067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5b4f-c8a8-4c8c-aed9-9363caa03fc9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:44.779586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5b4f-c8a8-4c8c-aed9-9363caa03fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:44.779586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5b4f-c8a8-4c8c-aed9-9363caa03fc9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:44.780948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 637/1296] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:44.786156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:44.786538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:44.786708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:44.804326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:44.805554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:44.877419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 660/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 06:46:44.900493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5b4f-c8a8-4c8c-aed9-9363caa03fc9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:44.998639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5b4f-c8a8-4c8c-aed9-9363caa03fc9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:45.030992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:45.031616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:45.031894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:45.032165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:45.032783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:45.034183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:45.042797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:45.044554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:45.045898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 638/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:46:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:45.050379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:45.068523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:45.147999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40f0d3-5718-4fa7-b107-78a956de9c24 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:45.181219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:45.181835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:45.182115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:45.182391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:45.183058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:45.183359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:45.185265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:45.190436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 661/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 06:46:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:45.196267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:45.226985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:45.292806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774073-18d1-424a-9417-8994a9e29dfe None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:45.326037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:45.326635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:45.326907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:45.327173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:45.327907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] RBAC: Adding query filter params (interface=public, service_id=cfd33cc87faa4449a144e83003762804, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:45.328211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:45.329590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e086213-46e6-4ace-9208-3b5d355b1fb8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:45.334399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 639/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 06:46:45 2022] GET /identity/v3/endpoints?service_id=cfd33cc87faa4449a144e83003762804&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:46:45.340155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:45.426894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:45.444821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b2b9e-d82e-4772-a3ab-bbf347d4e7cc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:45.477695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:45.478302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:45.478575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:45.478843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:45.479478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:45.480812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feee31-e3ed-41f7-a9e1-5cb67b61232e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:45.487887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 662/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 06:46:45 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:46:47.469216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d16f1-ba95-452e-92d4-100e595634bc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:47.469771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d16f1-ba95-452e-92d4-100e595634bc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:47.469771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d16f1-ba95-452e-92d4-100e595634bc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:47.471125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 640/1302] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:46:47.476123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:47.476554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:47.476653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:47.494706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:46:47.495870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:46:47.558641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 663/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:46:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 06:46:47.582071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d16f1-ba95-452e-92d4-100e595634bc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:47.677980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:47.685592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d16f1-ba95-452e-92d4-100e595634bc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:47.719681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:47.720258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:47.720537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:47.720809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:47.721464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:47.722823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 06:46:47.732029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 06:46:47.733220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: ERROR keystone.server.flask.application Aug 04 06:46:47.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 641/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 06:46:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 06:46:47.739511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:47.812237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:47.834659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895174c-4832-4b89-96e9-0bfab1f243a3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:47.868065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:47.868678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:47.868955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:47.869259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:47.869922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:46:47.870223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:47.871572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93df98-4cec-49fc-9bfd-b965f0fcf434 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:47.876579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 664/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 06:46:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:46:47.882516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:46:47.978191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b51ea-e4dc-4382-829c-85e43ba767a6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:46:48.010357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:46:48.010961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:46:48.011235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:46:48.011503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:46:48.012184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:46:48.014086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cffc9c-19b5-472b-85c4-504f3df9d0d6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:46:48.033248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 642/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:46:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:46:57.874413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=30 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:46:58.029910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:50.860321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71aa70-6b20-458f-8c36-0283bcf921d4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:50.860928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71aa70-6b20-458f-8c36-0283bcf921d4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:50.860928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71aa70-6b20-458f-8c36-0283bcf921d4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:50.868032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b5b0-10df-4744-a25f-840987b73aa5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:50.869179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b5b0-10df-4744-a25f-840987b73aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:50.869486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b5b0-10df-4744-a25f-840987b73aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:50.874478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 665/1307] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:47:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:47:50.954106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-42f1b5b0-10df-4744-a25f-840987b73aa5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:47:50.955396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-42f1b5b0-10df-4744-a25f-840987b73aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:51.063579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 643/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:47:51.116724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:51.117212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:51.117596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:51.120088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 666/1309] 10.222.0.36 () {54 vars in 965 bytes} [Thu Aug 4 06:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:47:51.126302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581cad1-c9e3-44c7-99c9-7ddc527f91a8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:51.126729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581cad1-c9e3-44c7-99c9-7ddc527f91a8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:51.127137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581cad1-c9e3-44c7-99c9-7ddc527f91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:51.245758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4581cad1-c9e3-44c7-99c9-7ddc527f91a8 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:47:51.246886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4581cad1-c9e3-44c7-99c9-7ddc527f91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:51.271241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:51.393700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 644/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Aug 4 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:47:51.403712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:47:51.408798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:51.557431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804f41-3bf6-4cc2-bd63-334355f91b07 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:47:51.644547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:47:51.645323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:51.645616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:51.646323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:51.647737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:51.707551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:51.766569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:47:51.767979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156150d-4701-44ba-8886-75e8d0a6f079 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:47:51.787424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 667/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:47:54.137781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc633f-99f7-47bc-9028-fe8525f2ef1c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:54.138311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc633f-99f7-47bc-9028-fe8525f2ef1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:54.138311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc633f-99f7-47bc-9028-fe8525f2ef1c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:54.139851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 645/1312] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:47:54.145006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a608f-2699-449f-8dc7-9ebae16154eb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:54.145431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a608f-2699-449f-8dc7-9ebae16154eb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:54.145567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a608f-2699-449f-8dc7-9ebae16154eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:54.230028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0d8a608f-2699-449f-8dc7-9ebae16154eb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:47:54.231245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0d8a608f-2699-449f-8dc7-9ebae16154eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:54.329164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 668/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:47:54.381153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:54.381595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:54.381978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:54.384112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 646/1314] 10.222.0.36 () {54 vars in 965 bytes} [Thu Aug 4 06:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:47:54.390992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7959-75ec-4a1e-a907-3374b6622423 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:54.391181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7959-75ec-4a1e-a907-3374b6622423 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:54.391460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7959-75ec-4a1e-a907-3374b6622423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:54.404334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:54.480936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0e5e7959-75ec-4a1e-a907-3374b6622423 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:47:54.482673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0e5e7959-75ec-4a1e-a907-3374b6622423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:54.575621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 669/1315] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Aug 4 06:47:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:47:54.584939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:47:54.586603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:54.701810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56c48-1273-4e50-953c-270df9d1c5c7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:47:54.779327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:54.782179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:47:54.783543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:54.783543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:54.783953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:54.785933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:54.896706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:47:54.898250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6c8b-1a95-47ff-8ae1-e04c62d91157 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:47:54.917134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 647/1316] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:47:57.462263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:57.462797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:57.462797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:57.464137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 670/1317] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:47:57.469302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbe01b-3b03-495a-a7d2-a5e83c28c427 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:57.469741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbe01b-3b03-495a-a7d2-a5e83c28c427 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:57.469859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbe01b-3b03-495a-a7d2-a5e83c28c427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:57.535739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-cddbe01b-3b03-495a-a7d2-a5e83c28c427 None None] MFA Rules not processed for user `22a09630f2c6495ebffc46802a44f338`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:47:57.536931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cddbe01b-3b03-495a-a7d2-a5e83c28c427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:57.589100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:57.634402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 648/1318] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:47:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:47:57.674113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:47:57.675662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:57.775740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d178f-452b-4054-b369-b1b871fc071b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:47:57.778419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:47:57.846703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:47:57.847313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:47:57.847677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:47:57.852050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:47:57.854342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:47:57.971676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:47:57.973142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b0f1-8917-4860-8476-6c15c08f6652 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:47:57.991208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 671/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:00.811615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:00.812063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:00.812157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:00.813529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 649/1320] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:00.818649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc82-1b82-4747-9f52-90cb7684f36e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:00.819086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc82-1b82-4747-9f52-90cb7684f36e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:00.819182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc82-1b82-4747-9f52-90cb7684f36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:00.861270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:00.888356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-553ebc82-1b82-4747-9f52-90cb7684f36e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:00.890545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-553ebc82-1b82-4747-9f52-90cb7684f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:00.997795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 672/1321] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:01.040301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:01.042002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:01.147198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811974c1-876b-4b95-aaf0-e8851437dc0e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:01.222517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:01.223134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:01.223412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:01.223684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:01.225324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:01.233356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:01.335199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:01.337128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa778ee-08b1-4ed5-9a52-97934e4151b4 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:01.355443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 650/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:04.043520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:04.044024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:04.044024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:04.045518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 673/1323] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:04.050605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c185-48b2-4f4a-a837-7f1bb30f857b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:04.050989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c185-48b2-4f4a-a837-7f1bb30f857b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:04.051155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c185-48b2-4f4a-a837-7f1bb30f857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:04.118192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-efb4c185-48b2-4f4a-a837-7f1bb30f857b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:04.119398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-efb4c185-48b2-4f4a-a837-7f1bb30f857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:04.178234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:04.225156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 651/1324] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:04.261202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:04.262756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:04.379092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9839-6009-45a8-b822-8f4154c17b1d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:04.392687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:04.459050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:04.459673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:04.459950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:04.460217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:04.461925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:04.574378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:04.575813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69d22-1a8f-41fc-804c-388d73cf0516 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:04.594683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 674/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:06.740093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:06.740610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:06.740610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:06.741964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 652/1326] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:06.748110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb2dd-f5cc-4720-b960-ed036fafe7bc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:06.748522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb2dd-f5cc-4720-b960-ed036fafe7bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:06.748631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb2dd-f5cc-4720-b960-ed036fafe7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:06.797827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:06.816787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cd8fb2dd-f5cc-4720-b960-ed036fafe7bc None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:06.818086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd8fb2dd-f5cc-4720-b960-ed036fafe7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:06.917171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 675/1327] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:06.953621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:06.955144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:07.066857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb680-96c5-45fd-b004-dc5d5f099b91 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:07.143274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:07.143900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:07.144177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:07.144447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:07.146155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:07.168558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:07.265631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:07.267057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f40f-abb9-4ba3-9bc2-c7e7fb273ba6 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:07.285708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 653/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:09.340249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:09.340820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:09.340820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:09.342237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 676/1329] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:09.347583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2f91-f08d-4791-b485-e204cc09ef22 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:09.347969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2f91-f08d-4791-b485-e204cc09ef22 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:09.348291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2f91-f08d-4791-b485-e204cc09ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:09.414379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-631e2f91-f08d-4791-b485-e204cc09ef22 None None] MFA Rules not processed for user `22a09630f2c6495ebffc46802a44f338`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:09.415637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-631e2f91-f08d-4791-b485-e204cc09ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:09.481589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:09.515021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 654/1330] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:09.552728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:09.554294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:09.661740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd846e4-c3f7-4dc3-9471-14fea0f1d92e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:09.682512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:09.741840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:09.743059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:09.743332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:09.743599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:09.745238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:09.856179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:09.857627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0174b0-af06-4ee5-bdc6-2a1c55319dd2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:09.875537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 677/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:12.334748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:12.335288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:12.335288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:12.337640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 655/1332] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:12.342679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89217e-e475-404c-a905-2bbf74bb79e0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:12.343102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89217e-e475-404c-a905-2bbf74bb79e0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:12.343229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89217e-e475-404c-a905-2bbf74bb79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:12.406694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:12.409564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3e89217e-e475-404c-a905-2bbf74bb79e0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:12.411306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e89217e-e475-404c-a905-2bbf74bb79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:12.504729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 678/1333] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:48:12.541323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:12.542844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:12.645695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9a14-3a3b-40c3-82b6-0739a3d7ca75 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:12.719566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:12.720177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:12.720455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:12.720728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:12.722346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:12.748925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:12.833063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:12.834773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cb03-3550-46b8-aaaa-584648f4ce40 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:12.854139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 656/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:14.904125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:14.904694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:14.904694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:14.906027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 679/1335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:14.911055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefcf5-6287-4f19-8264-7f9edab71b86 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:14.911500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefcf5-6287-4f19-8264-7f9edab71b86 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:14.911612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefcf5-6287-4f19-8264-7f9edab71b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:14.977476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a6cefcf5-6287-4f19-8264-7f9edab71b86 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:14.978589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a6cefcf5-6287-4f19-8264-7f9edab71b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:15.051033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:15.073301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 657/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:15.114895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:15.116409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:15.224098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402dceb-9aba-4367-8a7f-c250319964e0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:15.252399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:15.296716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:15.297360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:15.297639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:15.297908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:15.299495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:15.406408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:15.407836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401e70-cc9d-4c13-9469-0a46278f6691 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:15.425236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 680/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:17.908437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:17.908961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:17.908961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:17.910354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 658/1338] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:17.916128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb140-ef6f-4981-ba12-6c889a62f319 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:17.916550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb140-ef6f-4981-ba12-6c889a62f319 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:17.916663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb140-ef6f-4981-ba12-6c889a62f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:17.983306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6d0fb140-ef6f-4981-ba12-6c889a62f319 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:17.984517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6d0fb140-ef6f-4981-ba12-6c889a62f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:17.993369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:18.079945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 681/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:18.117345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:18.118892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:18.220136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760270-ed91-44f6-83e8-7d7615c37968 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:18.290761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:18.291374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:18.291649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:18.291919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:18.293556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:18.328945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:18.405849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:18.407296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32474-f70a-49fa-af4b-507f07140282 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:18.425392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 659/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:22.433255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:22.433817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:22.433817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:22.435387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 682/1341] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:22.440518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac07b-05ee-4f97-b0d8-1ffbb32f5fa0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:22.440921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac07b-05ee-4f97-b0d8-1ffbb32f5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:22.441132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac07b-05ee-4f97-b0d8-1ffbb32f5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:22.511061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d6fac07b-05ee-4f97-b0d8-1ffbb32f5fa0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:22.512288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d6fac07b-05ee-4f97-b0d8-1ffbb32f5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:22.601648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:22.613486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 660/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:22.653708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:22.655290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:22.760401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef4d87-3d72-45d3-8e66-3a062f01daa2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:22.796871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:22.834502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:22.835127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:22.835407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:22.835681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:22.837328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:22.946915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:22.948376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf889c0-88f2-4180-91d9-1a5b974a6826 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:22.966804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 683/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:25.597319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:25.597872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:25.598006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:25.599309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 661/1344] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:25.605904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41024a1-ab13-40b7-af02-7c605c6b571b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:25.606459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41024a1-ab13-40b7-af02-7c605c6b571b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:25.606459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41024a1-ab13-40b7-af02-7c605c6b571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:25.677806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f41024a1-ab13-40b7-af02-7c605c6b571b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:25.679139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f41024a1-ab13-40b7-af02-7c605c6b571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:25.700826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:25.777786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 684/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:25.815372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:25.816879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:25.921310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05832ba-4945-4c0a-8d4d-2e1719071e95 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:25.997140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:25.997761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:25.998045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:25.998316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:25.999927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:26.045762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:26.115275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:26.116806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fdf14-ece0-4dce-9aa1-415f3c36d2a9 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:26.136128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 662/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:30.119345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:30.119868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:30.119981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:30.121281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 685/1347] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:30.126421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c4c8-7a99-4871-a8dc-9801ad5c6f16 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:30.126829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c4c8-7a99-4871-a8dc-9801ad5c6f16 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:30.126976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c4c8-7a99-4871-a8dc-9801ad5c6f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:30.195109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4ba3c4c8-7a99-4871-a8dc-9801ad5c6f16 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:30.196305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4ba3c4c8-7a99-4871-a8dc-9801ad5c6f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:30.292923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:30.296114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 663/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:30.334851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:30.336461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:30.465289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817c8a-06a7-4789-b5d6-e2dd0ef86f3c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:30.517901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:30.546249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:30.546790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:30.547071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:30.547345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:30.548974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:30.668117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:30.669648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469db30-0372-4968-a23b-9dda8bc4a8de service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:30.689951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 686/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:35.680126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6198c1-74ee-46b2-a003-7cb5dc240d61 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:35.680550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6198c1-74ee-46b2-a003-7cb5dc240d61 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:35.680734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6198c1-74ee-46b2-a003-7cb5dc240d61 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:35.690483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d87c8-9ab3-46f9-bf8e-8329adba41ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:35.691642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d87c8-9ab3-46f9-bf8e-8329adba41ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:35.693326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 664/1350] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:48:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:35.694106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d87c8-9ab3-46f9-bf8e-8329adba41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:35.838657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7a6d87c8-9ab3-46f9-bf8e-8329adba41ea None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:35.840439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7a6d87c8-9ab3-46f9-bf8e-8329adba41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:35.862872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:35.983527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 687/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:48:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:40.082372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8aef8-e0a0-4ca6-bf07-63ad31781678 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:40.083205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8aef8-e0a0-4ca6-bf07-63ad31781678 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:40.084018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8aef8-e0a0-4ca6-bf07-63ad31781678 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:40.085549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 665/1352] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:40.091039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a3ff-9865-4c47-8620-520061b1ba54 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:40.091469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a3ff-9865-4c47-8620-520061b1ba54 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:40.091647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a3ff-9865-4c47-8620-520061b1ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:40.171419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6b44a3ff-9865-4c47-8620-520061b1ba54 None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:40.172772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b44a3ff-9865-4c47-8620-520061b1ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:40.248220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:40.290119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 688/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:48:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:41.761893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa36c-ac86-49c1-a9e6-9d3f3c98d0c5 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:41.762462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa36c-ac86-49c1-a9e6-9d3f3c98d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:41.762462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa36c-ac86-49c1-a9e6-9d3f3c98d0c5 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:41.763791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 666/1354] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:41.768801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8f2f-abac-478f-a315-3841d18eb491 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:41.769221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8f2f-abac-478f-a315-3841d18eb491 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:41.769494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8f2f-abac-478f-a315-3841d18eb491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:41.844489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dc5a8f2f-abac-478f-a315-3841d18eb491 None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:41.845723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dc5a8f2f-abac-478f-a315-3841d18eb491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:41.952186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 689/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:48:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:45.309648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8c59-2a39-4882-a199-d7bbe177d3be None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:45.310572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8c59-2a39-4882-a199-d7bbe177d3be None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:45.311013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8c59-2a39-4882-a199-d7bbe177d3be None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:45.312790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 667/1356] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:45.318429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee0c2-e4ea-4cc5-b790-f137886b70e2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:45.319277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee0c2-e4ea-4cc5-b790-f137886b70e2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:45.319734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee0c2-e4ea-4cc5-b790-f137886b70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:45.375353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:45.405828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-063ee0c2-e4ea-4cc5-b790-f137886b70e2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:45.407082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-063ee0c2-e4ea-4cc5-b790-f137886b70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:45.512750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 690/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:45.566972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:45.567601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:45.568594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:45.570955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 668/1358] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 06:48:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:45.580403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b678-fcf2-48a1-a015-a69355a9a934 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:45.581573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b678-fcf2-48a1-a015-a69355a9a934 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:45.582143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b678-fcf2-48a1-a015-a69355a9a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:45.667681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9f07b678-fcf2-48a1-a015-a69355a9a934 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:45.668866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f07b678-fcf2-48a1-a015-a69355a9a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:45.725363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:45.796880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 691/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 06:48:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:48:45.805123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:45.806711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:45.967576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d665-283e-4815-b2d7-83b6976f3181 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:46.049788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:46.092945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:46.093745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:46.094128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:46.094518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:46.096203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:46.191003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:46.192694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63254-20e2-46e3-8894-5b14cf3fccb7 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:46.214204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 669/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:48.485152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:48.486099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:48.486447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:48.488031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 692/1361] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:48.493764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e5da-097b-403f-bae5-271385184cf6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:48.494219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e5da-097b-403f-bae5-271385184cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:48.494329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10e5da-097b-403f-bae5-271385184cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:48.562098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7c10e5da-097b-403f-bae5-271385184cf6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:48.563290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7c10e5da-097b-403f-bae5-271385184cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:48.604002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:48.668453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 670/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:48.716040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:48.717562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:48.884345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0611-8243-4f33-8fd7-b463f198414e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:48.894355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:49.029970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:49.030599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:49.030876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:49.031144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:49.032774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:49.125303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:49.126908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd330dd-04fb-4205-bf8e-7cd0f2e7ce7d service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:49.146549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 693/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:51.513271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c9c4-418d-4f2a-b671-06c7fa00e942 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:51.513790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c9c4-418d-4f2a-b671-06c7fa00e942 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:51.513884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c9c4-418d-4f2a-b671-06c7fa00e942 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:51.515423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 671/1364] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:48:51.521211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3eb9b-db0c-4f09-987a-41133418bebd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:51.521693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3eb9b-db0c-4f09-987a-41133418bebd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:51.521775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3eb9b-db0c-4f09-987a-41133418bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:51.545143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:51.607749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cba3eb9b-db0c-4f09-987a-41133418bebd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:51.608939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cba3eb9b-db0c-4f09-987a-41133418bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:51.721091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 694/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:51.765691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:51.765966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:51.766236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:51.767700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 672/1366] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 06:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:51.773625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566cb8-cc8d-4dac-8803-349190f74a2e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:51.774148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566cb8-cc8d-4dac-8803-349190f74a2e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:51.774564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566cb8-cc8d-4dac-8803-349190f74a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:51.855042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eb566cb8-cc8d-4dac-8803-349190f74a2e None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:51.856374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb566cb8-cc8d-4dac-8803-349190f74a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:51.893035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:51.985172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 695/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 06:48:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:51.993280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:51.994944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:52.154980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567601c-2f57-4b2a-bfb5-0967a98ac875 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:52.181644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:52.275926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:52.276587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:52.276869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:52.277183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:52.278766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:52.371588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:52.373220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6ae1-6b00-4088-92c5-c1060efe8224 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:52.393320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 673/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:53.425773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382092-23f9-4557-b8ec-3e51becc9f67 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:53.426273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382092-23f9-4557-b8ec-3e51becc9f67 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:53.426273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382092-23f9-4557-b8ec-3e51becc9f67 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:53.427908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 696/1369] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:53.433413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7744c6-020f-4a6a-a099-c35d6b5d606d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:53.434249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7744c6-020f-4a6a-a099-c35d6b5d606d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:53.434731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7744c6-020f-4a6a-a099-c35d6b5d606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:53.475656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:53.511219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7d7744c6-020f-4a6a-a099-c35d6b5d606d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:53.512424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7d7744c6-020f-4a6a-a099-c35d6b5d606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:53.619418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 674/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:53.965712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:53.965712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:53.965712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:53.967488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 697/1371] 10.222.0.36 () {54 vars in 964 bytes} [Thu Aug 4 06:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:53.971734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff19f-5b73-459d-a85a-db2f0c5d07c6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:53.972112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff19f-5b73-459d-a85a-db2f0c5d07c6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:53.972283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff19f-5b73-459d-a85a-db2f0c5d07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:54.056582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-479ff19f-5b73-459d-a85a-db2f0c5d07c6 None None] MFA Rules not processed for user `fa7cd29afc2344ecbe9557ecb43b2801`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:54.057945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-479ff19f-5b73-459d-a85a-db2f0c5d07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:54.108582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:54.141107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 675/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Aug 4 06:48:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:48:54.148823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:54.150401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:54.265662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f733d1-2447-4a02-9ccb-16c13099ec8e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:54.307374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:54.343748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:54.344378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:54.344658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:54.344939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:54.346565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:54.455721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f498-8d1a-4d5b-803e-c6a6db3b4680 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:54.456184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f498-8d1a-4d5b-803e-c6a6db3b4680 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:54.456290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f498-8d1a-4d5b-803e-c6a6db3b4680 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:54.458119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 676/1373] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:48:54.462959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9f5c-c6ce-496a-b7f6-62a6257ac8af None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:54.463245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9f5c-c6ce-496a-b7f6-62a6257ac8af None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:54.463521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9f5c-c6ce-496a-b7f6-62a6257ac8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:54.464217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:54.465687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:54.485443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 698/1374] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:54.533747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c5ac9f5c-c6ce-496a-b7f6-62a6257ac8af None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:54.534958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c5ac9f5c-c6ce-496a-b7f6-62a6257ac8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:54.641128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 677/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:48:54.682196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:54.683397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:54.758983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:54.798976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eee147-952f-47c8-87df-79cbc9fc7bc1 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:54.938669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:54.939404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:54.939753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:54.940122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:54.941803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:55.022701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:55.033088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:55.034682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2682e-c2f5-4026-b209-b4f164cf89c2 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:55.053230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 699/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:57.116947 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:57.117483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:57.117483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:57.118860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 678/1377] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:57.124262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742bfe-0faa-41fb-b761-bde57ebc6239 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:57.124694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742bfe-0faa-41fb-b761-bde57ebc6239 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:57.124793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742bfe-0faa-41fb-b761-bde57ebc6239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:57.189071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4a742bfe-0faa-41fb-b761-bde57ebc6239 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:57.190270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4a742bfe-0faa-41fb-b761-bde57ebc6239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:57.284887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 700/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:48:57.336770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:48:57.338373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:57.392661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:57.501864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8e0a7-1fad-4398-b1ea-1bef5ee98fe5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:48:57.628736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:48:57.629315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:57.630132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:57.630412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:57.632017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:48:57.643697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:48:57.723635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:48:57.725305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f68a-69d1-46c6-b850-cedce608236c service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:48:57.743890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 679/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:48:59.873637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337149-2176-49f6-a705-7c6858dc532b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:59.874197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337149-2176-49f6-a705-7c6858dc532b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:59.874197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56337149-2176-49f6-a705-7c6858dc532b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:59.876229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 701/1380] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:48:59.880791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab41ee-dbac-4a7a-bf45-59067b21528a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:48:59.881251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab41ee-dbac-4a7a-bf45-59067b21528a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:48:59.881356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab41ee-dbac-4a7a-bf45-59067b21528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:48:59.952007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-77ab41ee-dbac-4a7a-bf45-59067b21528a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:48:59.953237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-77ab41ee-dbac-4a7a-bf45-59067b21528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:00.044075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:00.057875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 680/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:00.102904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56337149-2176-49f6-a705-7c6858dc532b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:00.104396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56337149-2176-49f6-a705-7c6858dc532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:00.184066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:00.273036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56337149-2176-49f6-a705-7c6858dc532b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:00.390732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:00.391313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:00.391633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:00.391873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:00.393517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:00.418791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:00.498098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:00.499701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f15432-5e8e-46d8-8fd2-e37ccf5026db service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:00.519469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 702/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:02.599555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:02.600406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:02.601097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:02.604182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 681/1383] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:02.610926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916705a-3be3-42a5-a311-18eb4cf9cc3b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:02.611387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916705a-3be3-42a5-a311-18eb4cf9cc3b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:02.611627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916705a-3be3-42a5-a311-18eb4cf9cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:02.691297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6916705a-3be3-42a5-a311-18eb4cf9cc3b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:02.693345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6916705a-3be3-42a5-a311-18eb4cf9cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:02.794368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:02.798527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 703/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:02.842063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:02.843983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:03.019130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778fe4-3c4b-4140-ad93-b83098e344a3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:03.088719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:03.146406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:03.147139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:03.147501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:03.147842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:03.149927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:03.253198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:03.255853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67599-e9ce-4f73-9164-9579574fdf55 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:03.275185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 682/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:05.899976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:05.900569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:05.900671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:05.902392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 704/1386] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:05.908842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e74c-0de3-467f-825a-ab3b7b640d44 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:05.909431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e74c-0de3-467f-825a-ab3b7b640d44 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:05.909771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e74c-0de3-467f-825a-ab3b7b640d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:05.991711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d1a1e74c-0de3-467f-825a-ab3b7b640d44 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:05.993201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1a1e74c-0de3-467f-825a-ab3b7b640d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:06.022860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:06.104401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 683/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:06.151823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:06.153436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:06.325566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760a053-ecf6-443b-b181-95d15853a9e3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:06.406119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:06.450783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:06.451411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:06.451690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:06.451965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:06.453622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:06.551593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:06.553422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6c0d-ef4f-4c90-b60d-65d2a10e343f service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:06.572405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 705/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:08.611800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:08.612355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:08.612355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:08.614637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 684/1389] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:08.619590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82728-ede5-48dd-993e-b031b16ba0e6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:08.619983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82728-ede5-48dd-993e-b031b16ba0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:08.620133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82728-ede5-48dd-993e-b031b16ba0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:08.687523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-aab82728-ede5-48dd-993e-b031b16ba0e6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:08.688735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aab82728-ede5-48dd-993e-b031b16ba0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:08.844369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:08.909420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 706/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:08.953511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:08.954994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:09.101843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82990-3c98-4ab0-b67a-98da93f38ec8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:09.110867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:09.217588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:09.218146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:09.218421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:09.218689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:09.220334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:09.312356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:09.314018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346bdc0-8214-4578-9b4c-31a94b8fc7ce service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:09.332500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 685/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:09.622487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf280-e8da-40d4-8570-b7b27e252e65 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:09.623065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf280-e8da-40d4-8570-b7b27e252e65 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:09.623065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf280-e8da-40d4-8570-b7b27e252e65 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:09.624379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 707/1392] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:09.630515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719732a-f061-4786-9a93-41a63264e9e7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:09.630949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719732a-f061-4786-9a93-41a63264e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:09.631074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719732a-f061-4786-9a93-41a63264e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:09.647340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:09.700754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d719732a-f061-4786-9a93-41a63264e9e7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:09.702083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d719732a-f061-4786-9a93-41a63264e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:09.798763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 686/1393] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:09.855296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:09.855583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:09.855855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:09.857249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 708/1394] 10.222.0.36 () {54 vars in 966 bytes} [Thu Aug 4 06:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:09.862376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e195-26c0-4036-a955-6e40c5503aa0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:09.862665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e195-26c0-4036-a955-6e40c5503aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:09.862941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3e195-26c0-4036-a955-6e40c5503aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:09.939316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f3c3e195-26c0-4036-a955-6e40c5503aa0 None None] MFA Rules not processed for user `18b61207b59f467596d6457eb998244d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:09.940519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f3c3e195-26c0-4036-a955-6e40c5503aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:09.975678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:10.017751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 687/1395] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Aug 4 06:49:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:10.025764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:10.027312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:10.128670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea2b4-0b1b-4baf-ad7d-044c789271d9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:10.190586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:10.201820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:10.202438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:10.202713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:10.202981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:10.204578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:10.311874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:10.313318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e976b17-52d5-4aa5-ae2a-034a1529d880 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:10.331629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 709/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:11.069372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f211ab-68d2-431f-b228-4fb37967eb92 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.069876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f211ab-68d2-431f-b228-4fb37967eb92 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.069876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f211ab-68d2-431f-b228-4fb37967eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.139321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a2f211ab-68d2-431f-b228-4fb37967eb92 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:11.140498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a2f211ab-68d2-431f-b228-4fb37967eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:11.225669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 688/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:11.272490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d041b-d508-4810-aa6a-2c0456b394ba None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.273056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d041b-d508-4810-aa6a-2c0456b394ba None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.273264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d041b-d508-4810-aa6a-2c0456b394ba None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.274731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 710/1398] 10.222.0.36 () {54 vars in 943 bytes} [Thu Aug 4 06:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:11.281246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.281612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.281885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.342151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:11.361007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] MFA Rules not processed for user `df74ba7216d64aa081a8ce2fbccb7b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:11.362202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:11.419632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437776b-3f13-47c1-b33d-e10c43273b4d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.419930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437776b-3f13-47c1-b33d-e10c43273b4d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.420202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437776b-3f13-47c1-b33d-e10c43273b4d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.421795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 711/1399] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:49:11.426971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.427241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.427507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.478658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 689/1400] 10.222.0.36 () {58 vars in 1040 bytes} [Thu Aug 4 06:49:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:49:11.488839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:11.498805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:11.499627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22abbd6-2372-48e7-afbd-936ae7d5a443 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:11.500003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:11.545723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:11.604265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 712/1401] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:49:11.613965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:11.620212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:11.620827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.621132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.621406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.623046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:11.649935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:11.651108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:11.709455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:11.711058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5677c2-dcd8-4051-9099-a2ac2da32683 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:11.719131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 690/1402] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 06:49:11.771566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac63f-e234-49c8-be1a-721795c77123 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:11.838925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:11.903269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:11.903795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:11.904066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:11.904329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:11.906001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:12.002046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:12.003636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828199-cfa6-41a4-9ad8-2d9edb4fae07 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:12.027667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 713/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:49:14.096461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:14.096461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:14.096461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:14.102076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 691/1404] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:14.103581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725358-8060-468a-aa8f-311801048813 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:14.104006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725358-8060-468a-aa8f-311801048813 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:14.104174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725358-8060-468a-aa8f-311801048813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:14.178075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1d725358-8060-468a-aa8f-311801048813 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:14.179317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1d725358-8060-468a-aa8f-311801048813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:14.197957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:14.299324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 714/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:49:14.344928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:14.346680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:14.513898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:14.525811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7214d3-1647-48b6-a553-eec5e18d730c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:14.659047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:14.659703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:14.660508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:14.660778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:14.662436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:14.767302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:14.768945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad9edc-81e7-4627-99ea-91eadb3046ee service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:14.779798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:14.790865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 692/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:16.882047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:16.882585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:16.882585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:16.887866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 715/1407] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:49:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:16.889201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e77b-1f44-4dc2-a350-f8a880550bde None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:16.889591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e77b-1f44-4dc2-a350-f8a880550bde None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:16.889794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e77b-1f44-4dc2-a350-f8a880550bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:16.967284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dc50e77b-1f44-4dc2-a350-f8a880550bde None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:16.968414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dc50e77b-1f44-4dc2-a350-f8a880550bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:17.074935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 693/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:49:17.122054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:17.123809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:17.286547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:17.288633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a47b-c855-4d88-99e3-30e060479f8f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:17.423932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:17.425098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:17.426218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:17.426726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:17.428616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:17.528570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:17.530237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4ddb3-b2d1-43e3-a47a-18637ebff914 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:17.550956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 716/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:27.072961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=67 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:27.547453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:33.983590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61a38-b4d1-4385-b4d0-e2d39137f9de None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:33.984111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61a38-b4d1-4385-b4d0-e2d39137f9de None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:33.984111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61a38-b4d1-4385-b4d0-e2d39137f9de None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:33.985468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 694/1410] 10.222.0.36 () {54 vars in 918 bytes} [Thu Aug 4 06:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:33.991100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dfdd-8c1f-486a-9610-f6e40104a3f6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:33.991545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dfdd-8c1f-486a-9610-f6e40104a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:33.991641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dfdd-8c1f-486a-9610-f6e40104a3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:34.064043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a499dfdd-8c1f-486a-9610-f6e40104a3f6 None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:34.065827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a499dfdd-8c1f-486a-9610-f6e40104a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:34.169521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 717/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Aug 4 06:49:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:34.184670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2e91-c44d-413e-84c0-54c45b256092 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:34.184949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2e91-c44d-413e-84c0-54c45b256092 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:34.185251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2e91-c44d-413e-84c0-54c45b256092 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:34.186587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 695/1412] 10.222.0.36 () {54 vars in 918 bytes} [Thu Aug 4 06:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:34.191165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512be1a-7661-458f-8acb-60a6ffa6bac8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:34.191473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512be1a-7661-458f-8acb-60a6ffa6bac8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:34.191748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512be1a-7661-458f-8acb-60a6ffa6bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:34.263901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:34.267161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6512be1a-7661-458f-8acb-60a6ffa6bac8 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:34.269063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6512be1a-7661-458f-8acb-60a6ffa6bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:34.381416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 718/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Aug 4 06:49:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:36.842470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:36.842985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:36.842985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:36.844349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:36.849696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57fa0e-8356-4ee5-acd6-cc779e3a8cbb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:36.850102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57fa0e-8356-4ee5-acd6-cc779e3a8cbb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:36.850224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57fa0e-8356-4ee5-acd6-cc779e3a8cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:36.914922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ce57fa0e-8356-4ee5-acd6-cc779e3a8cbb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:36.916109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ce57fa0e-8356-4ee5-acd6-cc779e3a8cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:36.969691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:37.011188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:37.054291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:37.055787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:37.199975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd44b-fa94-4f1c-9b58-6111b8412105 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:37.271609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:37.313788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:37.314433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:37.314773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:37.315055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:37.316800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:37.406709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:37.408299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a910-a158-4d5f-90e0-5c82fe72a4c4 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:37.427671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 697/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:38.336353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:38.336923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:38.336923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:38.338282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:38.343248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008390-ed21-4c62-89d4-542b0b9b63da None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:38.343686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008390-ed21-4c62-89d4-542b0b9b63da None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:38.343801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008390-ed21-4c62-89d4-542b0b9b63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:38.418313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ed008390-ed21-4c62-89d4-542b0b9b63da None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:38.419500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ed008390-ed21-4c62-89d4-542b0b9b63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:38.445810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:38.515002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:38.666361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:38.667789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:38.810058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80181d6e-06c9-402c-baed-e5e20024aa0c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:38.849167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:38.921617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:38.922164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:38.922439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:38.922714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:38.924848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:39.011337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:39.012902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1350-6465-4de6-897c-461269e654f7 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:39.030602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 721/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:49:39.911833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:39.912388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:39.912388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:39.913783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:39.918555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201672d-28c4-4543-8f64-612d77ceaca0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:39.918936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201672d-28c4-4543-8f64-612d77ceaca0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:39.919096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201672d-28c4-4543-8f64-612d77ceaca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:39.972027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:39.993647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1201672d-28c4-4543-8f64-612d77ceaca0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:39.994837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1201672d-28c4-4543-8f64-612d77ceaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:40.088259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:40.240948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:40.242425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:40.385626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363bbd-5c76-4dd1-9333-14de6b1ac40b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:40.397532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:40.500806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:40.501369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:40.501676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:40.501998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:40.503742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:40.592090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:40.593717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6ce7-e026-460c-a58d-e14c2108f0ea service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:40.611832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 700/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:41.472557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:41.473261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:41.473261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:41.474486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:41.479561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570907b-3aa1-4907-a031-0a4e8aa6bf40 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:41.479986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570907b-3aa1-4907-a031-0a4e8aa6bf40 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:41.480106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570907b-3aa1-4907-a031-0a4e8aa6bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:41.499736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:41.556503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f570907b-3aa1-4907-a031-0a4e8aa6bf40 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:41.557727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f570907b-3aa1-4907-a031-0a4e8aa6bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:41.659725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:49:41.812772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:41.814844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:41.923987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:41.963468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5d358-4287-4533-8bb5-f02fdc58ea64 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:42.075173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:42.075713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:42.075994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:42.076269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:42.077907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:42.153166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:42.166558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:42.168157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc8847-8cb1-4f01-9f0a-b7fb70219e05 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:42.186066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 724/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:43.060750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:43.061346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:43.061346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:43.062705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:43.067673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08a31-27d3-4ee1-aa5a-fec716f3cbe0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:43.068112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08a31-27d3-4ee1-aa5a-fec716f3cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:43.068248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08a31-27d3-4ee1-aa5a-fec716f3cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:43.143444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-85f08a31-27d3-4ee1-aa5a-fec716f3cbe0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:43.144635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-85f08a31-27d3-4ee1-aa5a-fec716f3cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:43.237846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:43.390395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:43.391885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:43.477950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:43.539706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c769-8ca4-40ce-a762-35dd08000f08 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:43.650927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:43.651463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:43.651734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:43.651999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:43.653623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:43.702311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:43.744401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:43.746215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d06537-d57d-4792-bfda-017740075c53 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:43.764349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 703/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:44.576593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:44.577196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:44.577196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:44.578530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:44.584456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828960dc-109f-4354-beca-eefc21164d06 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:44.584855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828960dc-109f-4354-beca-eefc21164d06 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:44.585015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828960dc-109f-4354-beca-eefc21164d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:44.660417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-828960dc-109f-4354-beca-eefc21164d06 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:44.661641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-828960dc-109f-4354-beca-eefc21164d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:44.760441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:44.929454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:44.930984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:44.979405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:45.075642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08312c3-99f8-435b-b787-9e6dcf5138e5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:45.185008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:45.185556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:45.185829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:45.186096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:45.187675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:45.195111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:45.276287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:45.277897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d939f3-51c0-4b33-8486-8ab76f4afc6c service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:45.295557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 727/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:46.108146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:46.108727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:46.108727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:46.110089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:46.115672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afbf1d-5ab9-41b2-8436-d260e5820d51 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:46.116073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afbf1d-5ab9-41b2-8436-d260e5820d51 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:46.116249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afbf1d-5ab9-41b2-8436-d260e5820d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:46.190401 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-09afbf1d-5ab9-41b2-8436-d260e5820d51 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:46.191590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-09afbf1d-5ab9-41b2-8436-d260e5820d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:46.257797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:46.286612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:46.436753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:46.438230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:46.455899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:46.585378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2aa00-770e-4f9b-8721-d2863977ef41 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:46.672091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:46.698024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:46.698561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:46.698834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:46.699102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:46.701211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:46.793841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:46.795426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bffb3-7025-4505-90b2-8798dd8981dc service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:46.813087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 706/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:47.621558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:47.622136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:47.622136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:47.623476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:47.628481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ce386-6cbc-4b9b-8255-8456f646d122 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:47.628917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ce386-6cbc-4b9b-8255-8456f646d122 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:47.629070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ce386-6cbc-4b9b-8255-8456f646d122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:47.703944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-296ce386-6cbc-4b9b-8255-8456f646d122 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:47.705191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-296ce386-6cbc-4b9b-8255-8456f646d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:47.746833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:47.807852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:47.958549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:47.960116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:48.107646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc80c-1124-43fa-a726-426b94d473bb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:48.160066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:48.218489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:48.219037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:48.219312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:48.219583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:48.222328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:48.310689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:48.312258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68279-f750-4363-a1ae-d881e7606455 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:48.330181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 730/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:49.137291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:49.137828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:49.137965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:49.139233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:49.144274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938744de-fbe9-4f01-98cb-d0cc525f9498 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:49.144684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938744de-fbe9-4f01-98cb-d0cc525f9498 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:49.144816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938744de-fbe9-4f01-98cb-d0cc525f9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:49.221542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-938744de-fbe9-4f01-98cb-d0cc525f9498 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:49.222748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-938744de-fbe9-4f01-98cb-d0cc525f9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:49.224734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:49.318606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:49.472495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:49.474001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:49.619393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70542568-43bb-4e3e-8143-8377dc788a1c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:49.646270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:49.732238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:49.732791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:49.733095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:49.733367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:49.734995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:49.829212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:49.831647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be95d8-67ee-4437-a4fc-8919e5695fcc service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:49.850981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 709/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:51.775040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:51.775587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:51.775587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:51.777016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:51.782886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc38ee-0aff-46e6-9c9f-db2cefe9b7cb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:51.783514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc38ee-0aff-46e6-9c9f-db2cefe9b7cb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:51.783514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc38ee-0aff-46e6-9c9f-db2cefe9b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:51.825578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:51.851109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-26dc38ee-0aff-46e6-9c9f-db2cefe9b7cb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:51.852310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-26dc38ee-0aff-46e6-9c9f-db2cefe9b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:51.948431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:51.987061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:51.988554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:52.088929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98428cee-2f8f-433d-9dd1-d5bfd60f9d3a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:52.120335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:52.160419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:52.161064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:52.161340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:52.161605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:52.163177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:52.267060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:52.268576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cddca-e565-44cc-a1ec-469888286c99 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:52.286972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 733/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:54.553084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:54.553613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:54.553613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:54.554984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:54.560115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b05c2-effa-41bf-9b2d-0f629c82c44e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:54.560495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b05c2-effa-41bf-9b2d-0f629c82c44e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:54.560692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b05c2-effa-41bf-9b2d-0f629c82c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:54.628004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e83b05c2-effa-41bf-9b2d-0f629c82c44e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:54.629224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e83b05c2-effa-41bf-9b2d-0f629c82c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:54.641635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:54.725922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:54.765061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:54.766566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:54.869027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35d89-9524-4350-82ff-62505f838f73 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:54.882227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:54.946084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:54.946621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:54.946897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:54.947167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:54.948763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:55.189812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:55.191242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1446ad-978e-4656-af5c-2ce1d41e1b10 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:55.208959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 712/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:49:57.564770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:57.565358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:57.565534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:57.566919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:49:57.572079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad2a6-83ac-41f7-be66-deed1e6325b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:57.572526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad2a6-83ac-41f7-be66-deed1e6325b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:57.572632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad2a6-83ac-41f7-be66-deed1e6325b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:57.620080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:57.638646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-634ad2a6-83ac-41f7-be66-deed1e6325b6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:49:57.639850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-634ad2a6-83ac-41f7-be66-deed1e6325b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:57.736480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:49:57.775706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:49:57.777222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:57.883947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b9fa-ffd5-48f0-a4c7-06706190b2d9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:49:57.922523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:49:57.956879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:49:57.957530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:49:57.957810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:49:57.958086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:49:57.959724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:49:58.069848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:49:58.071277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49593ecf-71b9-4258-8df3-0cf50566a872 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:49:58.089869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 736/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:00.219591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:00.220154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:00.220154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:00.222354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:00.227772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ea46-3215-406c-993b-8b9539186224 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:00.228173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ea46-3215-406c-993b-8b9539186224 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:00.228310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ea46-3215-406c-993b-8b9539186224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:00.293430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8603ea46-3215-406c-993b-8b9539186224 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:00.294642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8603ea46-3215-406c-993b-8b9539186224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:00.314417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:00.391266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:00.432221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:00.433839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:00.541980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb1b30-9ce5-49bc-a152-ee9c34a4694e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:00.566866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:00.644090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:00.644717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:00.645010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:00.645307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:00.646934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:00.762863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:00.764299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9572c-b003-4d65-959f-9ab4087f4ccd service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:00.783468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 715/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:02.928885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:02.929434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:02.929434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:02.930794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:02.935985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a5444-57ae-400b-8c87-db03deca00c3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:02.936361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a5444-57ae-400b-8c87-db03deca00c3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:02.936528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a5444-57ae-400b-8c87-db03deca00c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:02.999476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:03.002051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f91a5444-57ae-400b-8c87-db03deca00c3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:03.003822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f91a5444-57ae-400b-8c87-db03deca00c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:03.100327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:03.138648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:03.140188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:03.248735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52901-3e63-489c-a782-e995e863d567 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:03.297666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:03.321682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:03.322300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:03.322583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:03.322858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:03.324458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:03.432525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:03.433969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc5eb4-e0b2-4ee8-ae2b-a1e36194666d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:03.451670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 739/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:05.525995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:05.526531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:05.526531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:05.527871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:05.533180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8d3f-8beb-4866-839f-63ce31d8b9a1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:05.533737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8d3f-8beb-4866-839f-63ce31d8b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:05.534087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8d3f-8beb-4866-839f-63ce31d8b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:05.600383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b4af8d3f-8beb-4866-839f-63ce31d8b9a1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:05.601609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b4af8d3f-8beb-4866-839f-63ce31d8b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:05.630604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:05.697470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:05.737251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:05.738765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:05.839390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96d597-e16a-4657-9694-dc37c4513b33 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:05.868400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:05.914977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:05.915580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:05.915863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:05.916136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:05.917797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:06.030351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:06.031782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ab0c1-958c-43a2-8141-06c154afb553 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:06.052132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 718/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:08.143151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:08.143736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:08.143902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:08.145273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:08.150775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604c4e8-d17b-4383-903a-e86c9f1abdeb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:08.151181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604c4e8-d17b-4383-903a-e86c9f1abdeb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:08.151302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604c4e8-d17b-4383-903a-e86c9f1abdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:08.216743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5604c4e8-d17b-4383-903a-e86c9f1abdeb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:08.217974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5604c4e8-d17b-4383-903a-e86c9f1abdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:08.226251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:08.315393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:08.352727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:08.354299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:08.456853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f464c-7940-4301-a988-7d10baa6da95 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:08.512017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:08.529920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:08.530541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:08.530823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:08.531098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:08.532707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:08.641252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:08.642828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d97c0-7a81-4764-b97f-5dad10ed3de3 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:08.660766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 742/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:10.699444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:10.700003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:10.700003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:10.701359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:10.707087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c7b7-7e00-4ac2-8ea8-479df3a5ac1a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:10.707788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c7b7-7e00-4ac2-8ea8-479df3a5ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:10.707904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c7b7-7e00-4ac2-8ea8-479df3a5ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:10.774388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f359c7b7-7e00-4ac2-8ea8-479df3a5ac1a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:10.775581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f359c7b7-7e00-4ac2-8ea8-479df3a5ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:10.813405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:10.873066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:10.911229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:10.912732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:11.014979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9cdd6-4f6c-4b9f-be09-ab8ab9eb1ed1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:11.052493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:11.089105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:11.089715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:11.089988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:11.090261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:11.091842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:11.199056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:11.200478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683d836-57c5-493a-b6d2-fd55102f419e service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:11.218230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 721/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:13.246523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:13.247141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:13.247251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:13.248540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:13.254178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee23b-3547-44ce-a67b-9eb2bb43b7a5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:13.254627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee23b-3547-44ce-a67b-9eb2bb43b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:13.254753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee23b-3547-44ce-a67b-9eb2bb43b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:13.320931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-19dee23b-3547-44ce-a67b-9eb2bb43b7a5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:13.322138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-19dee23b-3547-44ce-a67b-9eb2bb43b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:13.340008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:13.418459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:13.454822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:13.456587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:13.557995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77953f4b-5c1b-42a9-8bd4-d5bc0c91545a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:13.624625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:13.631874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:13.632499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:13.632777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:13.633080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:13.634697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:13.746011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:13.747483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f3b96-d135-469c-ae89-1fc81586057d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:13.766007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 745/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:15.791722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:15.792261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:15.792261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:15.793641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:15.798899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515b7a-5274-428c-9669-880a039730b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:15.799623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515b7a-5274-428c-9669-880a039730b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:15.799623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515b7a-5274-428c-9669-880a039730b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:15.864492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1c515b7a-5274-428c-9669-880a039730b6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:15.865730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c515b7a-5274-428c-9669-880a039730b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:15.915109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:15.967151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:16.004899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:16.006453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:16.113501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3245-361f-42a2-a022-f757f3db7dcc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:16.161636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:16.188455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:16.189104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:16.189385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:16.190183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:16.191896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:16.298182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:16.303593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ee50-306b-46fa-92d2-caeb893f9030 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:16.321589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 724/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:25.965353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=22 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:26.319356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=66 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:35.883737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15c85-8795-465e-af94-5803a6c131ba None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:35.884222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15c85-8795-465e-af94-5803a6c131ba None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:35.884345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15c85-8795-465e-af94-5803a6c131ba None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:35.885641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 747/1471] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:35.891045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8ed-be24-4735-bf41-85c3c9b3b8b2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:35.891595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8ed-be24-4735-bf41-85c3c9b3b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:35.891711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740c8ed-be24-4735-bf41-85c3c9b3b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:35.958914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2740c8ed-be24-4735-bf41-85c3c9b3b8b2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:35.960276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2740c8ed-be24-4735-bf41-85c3c9b3b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:36.060633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 725/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:36.157559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:36.157846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:36.158117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:36.160624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 748/1473] 10.222.0.36 () {54 vars in 966 bytes} [Thu Aug 4 06:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:36.165511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447284d2-a591-4f59-a180-54bbc7401206 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:36.165823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447284d2-a591-4f59-a180-54bbc7401206 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:36.166097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447284d2-a591-4f59-a180-54bbc7401206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:36.240680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-447284d2-a591-4f59-a180-54bbc7401206 None None] MFA Rules not processed for user `18b61207b59f467596d6457eb998244d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:36.241886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-447284d2-a591-4f59-a180-54bbc7401206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:36.262789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:36.319054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 726/1474] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Aug 4 06:50:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:36.326400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:36.327883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:36.430697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc8d33-9dc8-47ed-b0ad-bef608488518 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:36.502406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:36.503483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:36.503780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:36.504120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:36.505756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:36.558215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:36.613160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:36.614597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3ab4-770e-4f3b-9e1c-7a102a240378 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:36.632635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 749/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:38.733967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:38.734447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:38.734547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:38.735868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 727/1476] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:38.741306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c52a6-92df-49ec-9d6f-d8d0df077f6d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:38.741771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c52a6-92df-49ec-9d6f-d8d0df077f6d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:38.741887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c52a6-92df-49ec-9d6f-d8d0df077f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:38.806762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fb3c52a6-92df-49ec-9d6f-d8d0df077f6d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:38.807948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb3c52a6-92df-49ec-9d6f-d8d0df077f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:38.902669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 750/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:38.924812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:38.926464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:39.050193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e949d3-8197-4e1d-ba58-43c0294c3313 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:39.098563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:39.143286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:39.144022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:39.144294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:39.144558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:39.145264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:39.146976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:50:39.146976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:50:39.146976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:50:39.148107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcd62-ed53-44f8-bed0-1d318a33e60b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:39.166113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 728/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 06:50:38 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:50:41.201879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:41.202444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:41.202444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:41.203786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 751/1479] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:41.209898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094d34-7504-459e-b372-e81f944d2118 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:41.210283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094d34-7504-459e-b372-e81f944d2118 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:41.210468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094d34-7504-459e-b372-e81f944d2118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:41.277657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-73094d34-7504-459e-b372-e81f944d2118 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:41.278848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-73094d34-7504-459e-b372-e81f944d2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:41.376020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 729/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:41.419311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:41.420837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:41.431213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:41.567916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552212e0-3a9e-4a1c-8230-f8c09bacc766 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:41.645907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:41.678890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:41.679507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:41.679779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:41.680044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:41.681690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:41.767506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:41.769232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af7b9-b192-46d9-b41f-9ae7a94b8055 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:41.787023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 752/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:50:43.956684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:43.957291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:43.957291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:43.958697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 730/1482] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:43.964313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bd83-e140-4908-b50f-8415e8ceb903 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:43.964776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bd83-e140-4908-b50f-8415e8ceb903 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:43.964884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bd83-e140-4908-b50f-8415e8ceb903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:44.029710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3a28bd83-e140-4908-b50f-8415e8ceb903 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:44.031020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3a28bd83-e140-4908-b50f-8415e8ceb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:44.076880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:44.126818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 753/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:44.163455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:44.165052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:44.188915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:44.270963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bca24-7d71-4cb2-a42a-2b9f32e0bcbf None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:44.342700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:44.343313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:44.343588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:44.343853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:44.345466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:44.418040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:44.452928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:44.454380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5047e-727d-4705-a294-d57ad72ca266 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:44.472544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 731/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:46.529864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:46.530408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:46.530408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:46.531770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 754/1485] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:46.538055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b77a-376b-4566-bb36-578a259ce11c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:46.538473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b77a-376b-4566-bb36-578a259ce11c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:46.538602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b77a-376b-4566-bb36-578a259ce11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:46.607480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7724b77a-376b-4566-bb36-578a259ce11c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:46.608757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7724b77a-376b-4566-bb36-578a259ce11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:46.705088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 732/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:46.743870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:46.745445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:46.846191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c37e8-6081-487a-aecd-f34d135ee899 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:46.916935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:46.918715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:46.919342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:46.919871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:46.920295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:46.922083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:47.027779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:47.029233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb3e31-02ea-4764-ae6e-c05c697c48ff service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:47.046887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 755/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:49.167074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:49.167639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:49.167639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:49.169063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 733/1488] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:49.174374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f032ca-dbd9-4e14-8ab7-d4a19321b068 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:49.174804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f032ca-dbd9-4e14-8ab7-d4a19321b068 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:49.174967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f032ca-dbd9-4e14-8ab7-d4a19321b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:49.240474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e4f032ca-dbd9-4e14-8ab7-d4a19321b068 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:49.241723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e4f032ca-dbd9-4e14-8ab7-d4a19321b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:49.294075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:49.338866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 756/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:49.385497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:49.387004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:49.424237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:49.494067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6e66-5227-452b-b8e8-8814e21f6023 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:49.568557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:49.569201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:49.569480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:49.569750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:49.571350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:49.651205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:49.680217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:49.681624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe20e3-6c5a-43d5-b5a1-7d7710bf1fa6 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:49.700113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 734/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:50:51.962445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:51.962981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:51.963102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:51.964443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 757/1491] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 06:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:50:51.969579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f9eb-e53d-40ec-8e70-af03d3fd7a9c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:51.970018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f9eb-e53d-40ec-8e70-af03d3fd7a9c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:51.970125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f9eb-e53d-40ec-8e70-af03d3fd7a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:52.037759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2213f9eb-e53d-40ec-8e70-af03d3fd7a9c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:50:52.038970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2213f9eb-e53d-40ec-8e70-af03d3fd7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:52.136359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 735/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 06:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:50:52.176585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:50:52.178164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:52.282873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de624f1-315f-42a3-b49d-f92092f5a63e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:50:52.355043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:50:52.355669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:50:52.355999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:50:52.356273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:50:52.357965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:50:52.368067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:50:52.466510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:50:52.467944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d4af-a91e-4737-9ed1-b01456f86889 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:50:52.485441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 758/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:51:02.134574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=82 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:51:02.483218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=50 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:03.072825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:03.073428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:03.073428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:03.151103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:52:03.152306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:03.248651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 736/1494] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:52:03.256937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:03.257454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:03.257562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:03.333226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:52:03.334016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:03.435701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 759/1495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:52:03.440386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:03.442653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:03.454020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19f928-69e2-4056-a092-85216e7ddd4b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:03.515978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:03.549682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:03.550293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:03.550577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:03.550849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:03.551790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:52:03.552096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:03.553138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:03.553138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:52:03.553138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:52:03.554020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:03.565155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 737/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:52:03.574101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:03.583629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246da6-ef50-4e42-ac2c-815cd35d59f8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:03.644500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:03.681437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:03.682052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:03.682330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:03.682602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:03.683255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:03.684965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:03.684965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:52:03.684965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:52:03.686180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:03.743239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 760/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:52:03 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:52:03.747495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:03.749122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:03.782031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd98b4-165e-45b2-a63e-1b08eec321aa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:03.875523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:03.876063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:03.876342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:03.876615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:03.877309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:03.878312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:03.878312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:52:03.878312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:52:03.880233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:03.920678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 738/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:52:03 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:52:03.924809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:03.926902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:03.989544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200db7-499a-41f1-acee-965d56302c09 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:04.075619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:04.087159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:04.087790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.088057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.088329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.089325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:04.090325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:04.090325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:52:04.090325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:52:04.091216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:04.103878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 761/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:52:04.108007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:04.109542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:04.121748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068ad26-80c5-42a7-a1bd-fc248034a45c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:04.146491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:04.217921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:04.218538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.218815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.219088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.219779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:04.220786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:04.220786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:52:04.220786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:52:04.221701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e06126-9be0-453d-8207-e2047094628c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:04.234482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 739/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:52:04.239361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:04.240927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:04.274536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228fd28-7a93-475a-a463-d19a69fca36e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:04.366694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:04.367372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.367649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.367921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] PATH_INFO: `/v3/projects/cb4bd249106845cf85241378287a3163/users/b0d580345ce446f6a87779a45a5af9fc/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.389844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4bd249106845cf85241378287a3163, user_id=b0d580345ce446f6a87779a45a5af9fc, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:04.390852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:04.390852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:52:04.390852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:52:04.392777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9dc55-4690-46e0-942d-282cff00845f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:04.417361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 762/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:52:04 2022] PUT /identity/v3/projects/cb4bd249106845cf85241378287a3163/users/b0d580345ce446f6a87779a45a5af9fc/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:52:04.429687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077347b-69c6-4307-b0fc-9c49a026bf48 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.429976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077347b-69c6-4307-b0fc-9c49a026bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.430255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077347b-69c6-4307-b0fc-9c49a026bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.486587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7077347b-69c6-4307-b0fc-9c49a026bf48 None None] MFA Rules not processed for user `b0d580345ce446f6a87779a45a5af9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:52:04.487794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7077347b-69c6-4307-b0fc-9c49a026bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:04.564790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 740/1502] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:52:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:52:04.582235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.582517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.582788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.584195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 763/1503] 10.222.0.36 () {54 vars in 964 bytes} [Thu Aug 4 06:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:52:04.589349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a5cc-fd46-4692-a01a-258a450676b9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.589663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a5cc-fd46-4692-a01a-258a450676b9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.589939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a5cc-fd46-4692-a01a-258a450676b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.620730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:04.664802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9b70a5cc-fd46-4692-a01a-258a450676b9 None None] MFA Rules not processed for user `fa7cd29afc2344ecbe9557ecb43b2801`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:52:04.666033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9b70a5cc-fd46-4692-a01a-258a450676b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:04.741691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 741/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Aug 4 06:52:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:52:04.749368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:04.750859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:04.800782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:04.855573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aee54-97a9-46fa-ba3b-f7768b102330 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:04.925914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:04.927104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:04.927387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:04.927661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:04.929294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:05.029414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:05.030855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:05.034344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:05.049381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 764/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:52:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:52:05.094696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d05ed-4ed0-4420-bcaa-5f8cfac3487c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:05.094984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d05ed-4ed0-4420-bcaa-5f8cfac3487c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:05.095257 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d05ed-4ed0-4420-bcaa-5f8cfac3487c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:05.096535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 742/1506] 10.222.0.36 () {52 vars in 830 bytes} [Thu Aug 4 06:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:52:05.100733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:05.101908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:05.198252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378701-15cf-416f-9b02-8e680b25d1b7 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:05.288892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:05.289552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:05.289741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:05.290010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] PATH_INFO: `/v3/users/b0d580345ce446f6a87779a45a5af9fc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:05.302425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d580345ce446f6a87779a45a5af9fc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:05.303447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:05.303447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:52:05.303447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:52:05.304664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:05.314055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:05.371010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d580345ce446f6a87779a45a5af9fc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:05.371453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d580345ce446f6a87779a45a5af9fc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:05.371971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d580345ce446f6a87779a45a5af9fc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:05.385986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d580345ce446f6a87779a45a5af9fc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:05.409725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d580345ce446f6a87779a45a5af9fc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:05.424159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 765/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:52:05 2022] DELETE /identity/v3/users/b0d580345ce446f6a87779a45a5af9fc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:52:05.428643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:05.429138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:05.429265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:05.485918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:52:05.487124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:05.565149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:05.579262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 743/1508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:52:05.589253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:05.590469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:05.689818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8413-f95f-4c0b-9879-df6d652871df admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:05.746381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:05.766286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:05.766909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:05.767188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:05.767462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:05.769089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:05.874454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:05.875798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecafb69-0fca-4f0b-8832-334b1d26a3e5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:05.895534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 766/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:52:06.221463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:52:06.222951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:52:06.234366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea377b3-ea33-4da5-8c78-2fb61d5d8910 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:52:06.333499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:52:06.334139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:52:06.334418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:52:06.334695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] PATH_INFO: `/v3/projects/cb4bd249106845cf85241378287a3163` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:52:06.344863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4bd249106845cf85241378287a3163)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:52:06.345915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:52:06.345915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:52:06.345915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:52:06.347111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:52:06.404506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4bd249106845cf85241378287a3163', 'request_id': 'req-40fe85ee-5f27-4b48-abc1-17df0c08ae42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:06.411029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4bd249106845cf85241378287a3163', 'request_id': 'req-40fe85ee-5f27-4b48-abc1-17df0c08ae42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:06.423797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4bd249106845cf85241378287a3163', 'request_id': 'req-40fe85ee-5f27-4b48-abc1-17df0c08ae42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:06.449767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] The token cache is being invalidate because project cb4bd249106845cf85241378287a3163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:52:06.450354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:06.450449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-40fe85ee-5f27-4b48-abc1-17df0c08ae42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:52:06.451868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 744/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:52:06 2022] DELETE /identity/v3/projects/cb4bd249106845cf85241378287a3163 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:52:15.893031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=62 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:52:16.447584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:53:35.705889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:35.706360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:35.706469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:35.707804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:35.713210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a781f-2b84-4369-aa63-c1cbc2ba78dc None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:35.713662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a781f-2b84-4369-aa63-c1cbc2ba78dc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:35.713773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a781f-2b84-4369-aa63-c1cbc2ba78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:35.795116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-768a781f-2b84-4369-aa63-c1cbc2ba78dc None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:35.796338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-768a781f-2b84-4369-aa63-c1cbc2ba78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:35.902115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:36.056692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:36.058773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:36.175421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27543c6-b839-4749-a889-936bd3e6ea16 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:36.181442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:36.182062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:36.182344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:36.182621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:36.190694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:36.192273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2db1b-b7d5-4732-9705-42b60e7e6c0c service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:36.202374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 768/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:37.011346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6ee5-7db6-4288-85b1-06d4e29619fa None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:37.011346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6ee5-7db6-4288-85b1-06d4e29619fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:37.011346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6ee5-7db6-4288-85b1-06d4e29619fa None None] PATH_INFO: `/v3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:37.011953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 746/1514] 10.222.0.49 () {54 vars in 925 bytes} [Thu Aug 4 06:53:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:53:37.018764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8423f-f15d-48a6-bf99-d6f29c4eecd0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:37.019203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8423f-f15d-48a6-bf99-d6f29c4eecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:37.019285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8423f-f15d-48a6-bf99-d6f29c4eecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:37.046285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ae42-d328-40e6-84d1-622702ad76ea None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:37.046564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ae42-d328-40e6-84d1-622702ad76ea None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:37.046841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ae42-d328-40e6-84d1-622702ad76ea None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:37.048421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 747/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:53:37.052775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:37.053092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:37.053371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:37.072784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:37.074111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:37.080576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7ef8423f-f15d-48a6-bf99-d6f29c4eecd0 None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:37.081771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ef8423f-f15d-48a6-bf99-d6f29c4eecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:37.082339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 748/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:53:37.152791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:53:37.158587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 769/1517] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Aug 4 06:53:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:37.237659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:37.249918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b260b0-b9c6-4f4f-9fff-8fd8a6c6f653 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:37.255174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:37.255780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:37.256050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:37.256316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:37.264875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:37.266478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34045ecd-9d5e-44ac-8b78-5d499b42cd72 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:37.276280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 749/1518] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:46.239942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11721e62-107e-4136-9773-07f428b32787 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:46.240493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11721e62-107e-4136-9773-07f428b32787 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:46.240493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11721e62-107e-4136-9773-07f428b32787 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:46.241845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 770/1519] 10.222.0.36 () {54 vars in 961 bytes} [Thu Aug 4 06:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:46.247008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f17cf9-f40d-4c40-a1f4-716c98e8632f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:46.247437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f17cf9-f40d-4c40-a1f4-716c98e8632f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:46.247552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f17cf9-f40d-4c40-a1f4-716c98e8632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:46.266916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c8f17cf9-f40d-4c40-a1f4-716c98e8632f None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:46.268086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c8f17cf9-f40d-4c40-a1f4-716c98e8632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:46.277149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 750/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Aug 4 06:53:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:46.284387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11721e62-107e-4136-9773-07f428b32787 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:46.297710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11721e62-107e-4136-9773-07f428b32787 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:46.302561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:46.303159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:46.303437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:46.303708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:46.311992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:46.313602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068652-4ddc-494d-868b-cabd07d11c25 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:46.323542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 771/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:53:48.529794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2331-5e24-4085-8714-53b579b6959b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:48.530414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2331-5e24-4085-8714-53b579b6959b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:48.530414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2331-5e24-4085-8714-53b579b6959b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:48.531705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:48.536572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91163758-0325-4365-8ca3-3c3634ef77d7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:48.536997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91163758-0325-4365-8ca3-3c3634ef77d7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:48.537154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91163758-0325-4365-8ca3-3c3634ef77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:48.557898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-91163758-0325-4365-8ca3-3c3634ef77d7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:48.559106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-91163758-0325-4365-8ca3-3c3634ef77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:48.567180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:48.725635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2331-5e24-4085-8714-53b579b6959b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:48.740711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2331-5e24-4085-8714-53b579b6959b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:48.746437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:48.747036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:48.747310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:48.747576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:48.755452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:48.757046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c9b2a-44d8-49a9-97ab-acd888c48714 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:48.766125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 752/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:49.576083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412cb-2535-48eb-984f-61566f102cc2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:49.576550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412cb-2535-48eb-984f-61566f102cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:49.576654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412cb-2535-48eb-984f-61566f102cc2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:49.578038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 06:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:49.583864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0a54-88eb-425d-a3c2-30f8a72501e1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:49.584304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0a54-88eb-425d-a3c2-30f8a72501e1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:49.584768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0a54-88eb-425d-a3c2-30f8a72501e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:49.607168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-86de0a54-88eb-425d-a3c2-30f8a72501e1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:49.608339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-86de0a54-88eb-425d-a3c2-30f8a72501e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:49.615961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 06:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:49.774501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc412cb-2535-48eb-984f-61566f102cc2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:49.788776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc412cb-2535-48eb-984f-61566f102cc2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:49.794247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:49.794854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:49.795135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:49.795410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:49.803409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:49.804960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3c879-7578-46d8-b76a-85a11dc5d744 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:49.814297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 774/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:53.711137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:53.711576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:53.711681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:53.713056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:53.718497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488528f-baa8-4026-bb02-6aeb4e58cee6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:53.718890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488528f-baa8-4026-bb02-6aeb4e58cee6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:53.719089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488528f-baa8-4026-bb02-6aeb4e58cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:53.738465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6488528f-baa8-4026-bb02-6aeb4e58cee6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:53.739652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6488528f-baa8-4026-bb02-6aeb4e58cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:53.747977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:53.820071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:53.821818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:53.847791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:53:53.900112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea326-aaac-42ae-a6c7-52f44e977c15 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:53.903613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:53.904224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:53.904503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:53.904777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:53.913673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:53.915811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dba39-c88b-436c-920d-c4aa395fa8dc service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:53.925060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 755/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:55.922129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:55.922689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:55.922689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:55.924020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:55.929308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7e3e-13a6-430d-a5fb-55d13c433dbf None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:55.934343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7e3e-13a6-430d-a5fb-55d13c433dbf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:55.934343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7e3e-13a6-430d-a5fb-55d13c433dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:55.949630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e71a7e3e-13a6-430d-a5fb-55d13c433dbf None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:55.950807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e71a7e3e-13a6-430d-a5fb-55d13c433dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:55.958634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:53:55.996388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:53:55.998131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:56.012877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591c95-dee5-4767-93f5-85bcba89f11d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:53:56.016320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:53:56.016929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:56.017310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:56.017580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:56.026189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:53:56.027605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc86ac-8aee-4cf9-b936-8443b31a2332 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:53:56.036669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 777/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:53:59.659505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:59.660104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:59.660104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:59.661483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:53:59.667251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6e06-4b32-4a25-bb87-60f701a97e6f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:53:59.667636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6e06-4b32-4a25-bb87-60f701a97e6f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:53:59.667808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6e06-4b32-4a25-bb87-60f701a97e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:53:59.688252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c0fd6e06-4b32-4a25-bb87-60f701a97e6f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:53:59.689472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0fd6e06-4b32-4a25-bb87-60f701a97e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:53:59.697576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:54:00.009493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:54:00.011160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:54:00.086308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8294-1723-4daa-98cd-62dca23b7a38 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:54:00.089804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:54:00.090407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:54:00.090681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:54:00.090950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:54:00.100002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:54:00.101639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae7e3-013d-4528-98a6-07e72f13e87e service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:54:00.110966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 758/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:54:02.154364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:54:02.154921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:54:02.154921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:54:02.156261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 06:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:54:02.161374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c561-aebf-4d64-b3fd-01a0fa6bc68a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:54:02.161802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c561-aebf-4d64-b3fd-01a0fa6bc68a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:54:02.161912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c561-aebf-4d64-b3fd-01a0fa6bc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:54:02.182598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4534c561-aebf-4d64-b3fd-01a0fa6bc68a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:54:02.183779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4534c561-aebf-4d64-b3fd-01a0fa6bc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:54:02.191755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 06:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:54:02.500569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:54:02.502265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:54:02.515833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692efc-d59e-4d4c-81bd-e4057d6ad6ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:54:02.519382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:54:02.519987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:54:02.520271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:54:02.520550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:54:02.529520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:54:02.530949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5eeb-0d75-4b03-83e1-f3a90b3350f9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:54:02.540776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 780/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:54:12.177510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=66 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:54:12.536133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=34 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:28.051329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac183e0-1f4d-4781-927d-73d7bb642757 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.051937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac183e0-1f4d-4781-927d-73d7bb642757 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.051937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac183e0-1f4d-4781-927d-73d7bb642757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.077029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0ac183e0-1f4d-4781-927d-73d7bb642757 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.078644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0ac183e0-1f4d-4781-927d-73d7bb642757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.084622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad859-6198-499a-a303-c80a91660756 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.085262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad859-6198-499a-a303-c80a91660756 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.085262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad859-6198-499a-a303-c80a91660756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.088944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 760/1540] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.090599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630227d7-0d59-4214-a69a-6401ced91ce3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.091150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630227d7-0d59-4214-a69a-6401ced91ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.091693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630227d7-0d59-4214-a69a-6401ced91ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.121319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-541ad859-6198-499a-a303-c80a91660756 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.122542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-541ad859-6198-499a-a303-c80a91660756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.123382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-630227d7-0d59-4214-a69a-6401ced91ce3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.124771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-630227d7-0d59-4214-a69a-6401ced91ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.141465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 781/1541] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:55:28.142870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.143155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.143430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.144660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 761/1542] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.158423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c158077-cbf5-4ae8-8c77-4d70dfa14646 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.159133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c158077-cbf5-4ae8-8c77-4d70dfa14646 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.159637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c158077-cbf5-4ae8-8c77-4d70dfa14646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.190030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.191121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4c158077-cbf5-4ae8-8c77-4d70dfa14646 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.191271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.192740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c158077-cbf5-4ae8-8c77-4d70dfa14646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.208171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 762/1543] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 04 06:55:28.214331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b036-a364-48e6-8057-679eda5f6f4d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.214905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b036-a364-48e6-8057-679eda5f6f4d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.215033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 782/1544] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.215524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b036-a364-48e6-8057-679eda5f6f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.215804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.237339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae95ff-d081-4935-a980-0a5f12f17015 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.245745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bde3b036-a364-48e6-8057-679eda5f6f4d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.248174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bde3b036-a364-48e6-8057-679eda5f6f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.248958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.249942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.250385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.250829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.251697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.252229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.253458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:28.253458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:55:28.253458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:55:28.257443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.268027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 763/1545] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.272958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a609a7-ff32-4120-9e85-c408fbd6bb98 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.272958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a609a7-ff32-4120-9e85-c408fbd6bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.272958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a609a7-ff32-4120-9e85-c408fbd6bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.279985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 783/1546] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.281211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.296277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93375ed5-e16c-448b-be91-73a6a0a4b296 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.300830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-07a609a7-ff32-4120-9e85-c408fbd6bb98 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.301125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.301809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.302035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.302305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.303836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-07a609a7-ff32-4120-9e85-c408fbd6bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.304423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.304730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.306379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047303a0-447e-4d47-b0aa-1dc9f3462e4e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.315001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 764/1547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.317582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.317871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.318185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.320162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 784/1548] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.323604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.323604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.323604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.341433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.342570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.342681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.344250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.351519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 765/1549] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.352323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.354304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 785/1550] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.354967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.362562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c98178-54cd-40e6-ab66-68b0e22fcc92 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.368022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.368640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.368921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.369298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.369990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.370294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.371901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f37f73-1783-4e05-a6c3-0a488e8909b5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.374075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6edf6-d715-4a59-855f-06de85bee17a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.378785 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.379400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.379675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.379946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.380598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.382722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7e32-a122-4877-8ca1-37098068f5e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.384240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 766/1551] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.385483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20626-6250-4c55-9555-91f9095c86e6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.385765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20626-6250-4c55-9555-91f9095c86e6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.386043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20626-6250-4c55-9555-91f9095c86e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.405541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-72e20626-6250-4c55-9555-91f9095c86e6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.406746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-72e20626-6250-4c55-9555-91f9095c86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.415979 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 767/1552] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.417198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.417486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.417763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.425087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 786/1553] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.425087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a43b-cfff-4f7a-917c-3cac22c00ca3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.425087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a43b-cfff-4f7a-917c-3cac22c00ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.425087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a43b-cfff-4f7a-917c-3cac22c00ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.440364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.441578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.444342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4408a43b-cfff-4f7a-917c-3cac22c00ca3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.445548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4408a43b-cfff-4f7a-917c-3cac22c00ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.503539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 768/1554] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.504361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.505284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 787/1555] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.506676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc2c97-1288-444a-997c-d800a7414450 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.506972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc2c97-1288-444a-997c-d800a7414450 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.507249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc2c97-1288-444a-997c-d800a7414450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.520044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb963-13f0-41f6-9ca5-ee234d67d15a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.525429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.526039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.526317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.526587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.527312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-52cc2c97-1288-444a-997c-d800a7414450 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.527430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.528353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:28.528353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:55:28.528353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:55:28.528594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-52cc2c97-1288-444a-997c-d800a7414450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.529563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.536411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 788/1556] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.538597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f626-28fe-48ff-802b-6a6ff183d1a0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.538886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f626-28fe-48ff-802b-6a6ff183d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.539162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f626-28fe-48ff-802b-6a6ff183d1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.558584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 769/1557] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.559457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.562736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1150f626-28fe-48ff-802b-6a6ff183d1a0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.563962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1150f626-28fe-48ff-802b-6a6ff183d1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.621894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73f58-a026-4fd8-a200-778fba89f0fc admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.623723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 789/1558] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.626982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.627610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.627894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.628178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.628693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.629015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.629119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.629294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.631702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dd59b-f506-4d8a-8cbf-44c38c8e7e85 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.649521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.650728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.659001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 790/1559] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.659742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.665057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 770/1560] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.667185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.667478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.667957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.671177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafc0c1-6d49-476b-a1ef-6fbde6fce4ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.678609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:28.679582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:28.692274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:28.693710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:28.731696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.732312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.732588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.732856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.733540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.734543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:28.734543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:55:28.734543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:55:28.735732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.753706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 771/1561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:28.754538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.761141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 791/1562] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.761141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.766620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030c33-7a28-4cb5-b20f-962e7088be19 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.768921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7fa6-8100-401e-8b20-432379ed909c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.771214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.772624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.772898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.773193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.773974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.774282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.774795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.775423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.775706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.775867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.775985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.776670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.776995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.778615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.787969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 772/1563] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.788762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.799230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 792/1564] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.799230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.799728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63138-9b6e-44cb-ae25-3076e2e48d56 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.804261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.804857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.805178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.805447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.806185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.808007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.809674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fbf8-df93-4111-8d04-ec5076a489ba admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.814408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.815015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.815291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.815559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.816288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.816586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.819132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.830510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 773/1565] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.831105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 793/1566] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.831590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.832067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.842296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf5b8-1ecf-486f-9980-e9572ab90737 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.846510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa352b-ff30-4fc7-a90f-86e0fd23938c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.847109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.847710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.847986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.848258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.848937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.849281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.850909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.852028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.852755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.853176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.853456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.854115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.856019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.862462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 774/1567] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.863385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.875041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6120-4065-4205-933f-11cca24bd545 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.880012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 794/1568] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.880012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.882695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.883307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.883592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.883865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.884543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:28.884845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.886541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.888446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088134-46de-4d81-a5f7-9269ae66b737 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.893309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.893908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.894191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.894465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.895147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.897291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.899490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 775/1569] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:28.900372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.908094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 795/1570] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:28.908884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.914609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982167-0e7c-4809-8ab0-f576a0e1f30f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.918749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd20c3-66b9-47b5-add1-9c5b904f7c85 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:28.919078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.919691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.919968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.920239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.920885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.922817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.923571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:28.924164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:28.924441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:28.924750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:28.925453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:28.927502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:28.953609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 776/1571] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.953609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:28.955811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 796/1572] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:28.956630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.013677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf689fc-2d8c-4611-94f8-2757345570ed admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.018384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.018989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.019266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.019367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db6bb-8fc7-4951-8656-076d178763b0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.019533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.020239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.021938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.024601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.025252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.025529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.025800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.026453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.028924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.031740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 777/1573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.032491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.042971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6624fa-c73c-48ad-a7de-936e16fbfcce admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.047488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.048080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.048383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.048621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.049300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.051385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.059103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 797/1574] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.061501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.071034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.075923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.082666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 778/1575] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.083943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.129566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ac14-abf1-4fa6-b140-fcf9be08621f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.145342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7f61-c15f-4e0a-a91f-27c088ba85d9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.150453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.151063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.151337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.151605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.152252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.154171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.182798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 779/1576] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.183816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.186208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.186830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.187107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.187375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.188082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.189717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.199448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 798/1577] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.200288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.210303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34e2e-9fad-44e7-ad07-5d5ddd47982d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.247574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76eecd-02ba-4005-bc9e-8923a79c2fbf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.252394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.253037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.253313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.253633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.254323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.256782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.264932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.265572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.265853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.266121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.266771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.267566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 780/1578] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.268348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.268740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.280597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366435e3-0157-4a51-8b42-3eb413fb0263 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.285661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.286135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.286412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.286683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.287364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.289269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.291986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 799/1579] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.292893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.302464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc58524-1e8c-431d-8c17-74786eaa5495 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.308038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.308642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.308930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.309236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.309923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.311556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.315384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 781/1580] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/users => generated 301 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.315384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.322777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fe51-416d-4a46-90fc-cb8db13ed76c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.325194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 800/1581] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.325804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.327438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.328251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.328377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.328652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.329327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.331284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.335698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d3e6-cf7c-482f-983b-c9399d07a9dd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.340269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.340902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.341216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.341491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.342144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.344551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.357699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 782/1582] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.357699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.366193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb241-da1e-47be-8d8c-e5bde56d6340 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.371296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.372071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.372403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 801/1583] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.372711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.373025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.373247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.373675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.375650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.384879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0164e-e4ca-45a4-8501-576fcd47e718 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.390132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.391004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.391431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.391825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.392620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.394346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.397359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 783/1584] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:29.398149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.405691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 802/1585] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.406608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.411096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841192d0-499a-4398-b4e6-a51eaa9adda9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.411529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.416698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.417393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.417668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.417774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913d69-4e51-461b-8e5c-20db8f6b09cf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.417935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] PATH_INFO: `/v3/projects/3304921d3a6e4ec6a02b21cc8bd252e8/users/a20eec282155471781c18b212b96e4d0/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.423266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.423986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.424272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.424598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.425312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.427045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.434724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3304921d3a6e4ec6a02b21cc8bd252e8, user_id=a20eec282155471781c18b212b96e4d0, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.435898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:29.435898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:55:29.435898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:55:29.437624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 803/1586] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.438200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.438423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.448598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d78e-7f4f-4348-99f4-59c7adbb6b8e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.451475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 784/1587] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:29 2022] PUT /identity/v3/projects/3304921d3a6e4ec6a02b21cc8bd252e8/users/a20eec282155471781c18b212b96e4d0/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:29.461154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.461154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.505143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.506419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.506826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.507105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.507796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.509425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.518994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 804/1588] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.519799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.521892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a4e6f-845b-4028-b635-148e53173ffe admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.526593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.527258 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.527534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.527807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] PATH_INFO: `/v3/projects/54ddd1a45bb94faf8b30e184f42d7d46/users/8d166fbb12a44ce6a8b992144b06d9cc/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.530835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b619-5e1a-4c77-8892-0c5e76587287 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.535475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.536075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.536355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.536641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.537885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.539467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.542872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ddd1a45bb94faf8b30e184f42d7d46, user_id=8d166fbb12a44ce6a8b992144b06d9cc, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.545536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.549402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 805/1589] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.550337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.560779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b20f-ea93-4c7f-9114-22dee0f46cd4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.563569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 785/1590] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:29 2022] PUT /identity/v3/projects/54ddd1a45bb94faf8b30e184f42d7d46/users/8d166fbb12a44ce6a8b992144b06d9cc/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:29.564273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.626370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7680b6-3134-4ce1-9a01-b52f1e0202c9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.627882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.628507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.628788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.629095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.629784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.630938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.631468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.631590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.631845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.632124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.632810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.634470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.641734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 806/1591] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.642683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.644683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 786/1592] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.645482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.652837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4084f-792b-4f24-933e-26ab2e81d7b1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.654816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6241-24ab-4af0-9b29-648c144ac49f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.657478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.658132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.658410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.658685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] PATH_INFO: `/v3/projects/1cb16b89aa804519b731998a240078bf/users/ef69b4c27829488180e2d9ac5494e3fa/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.659344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.659928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.660205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.660475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.661178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.663293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c08f2-d4cf-49ad-af17-a863c41d344c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.673347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 787/1593] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.673889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb16b89aa804519b731998a240078bf, user_id=ef69b4c27829488180e2d9ac5494e3fa, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.675558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.675866 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.676119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.676538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.690514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 807/1594] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:29 2022] PUT /identity/v3/projects/1cb16b89aa804519b731998a240078bf/users/ef69b4c27829488180e2d9ac5494e3fa/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:29.691773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.706426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] MFA Rules not processed for user `a20eec282155471781c18b212b96e4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:29.707669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:29.749183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.770947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a620da-83a7-4bc0-bd23-06bbc480cca8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.775792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 788/1595] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:29.780056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.780907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.781843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.782474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.782474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.782910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:29.783033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.784611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d7d9e-0b0d-433d-bbae-444e7f38e81d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.790171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd5f3f-ff76-45ca-8494-b6aff2a4cf2a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.795786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.796227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 808/1596] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.796426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.796685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.797064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.797514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9f10d-5074-4dda-bbfd-560244dbc39a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.797762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.797872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9f10d-5074-4dda-bbfd-560244dbc39a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.798059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9f10d-5074-4dda-bbfd-560244dbc39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.799725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.813019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 789/1597] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.813019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.821363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb401f6-d868-4079-8369-1003563a6408 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.825901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.826502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.826783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.827058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.827761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.829066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2ba9f10d-5074-4dda-bbfd-560244dbc39a None None] MFA Rules not processed for user `8d166fbb12a44ce6a8b992144b06d9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:29.830020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.830392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ba9f10d-5074-4dda-bbfd-560244dbc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:29.841176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 790/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.842227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.854128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1081-d19a-4744-8108-a5d1a12c1095 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.858752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.859352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.859633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.859907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.860581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.862206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.873641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 791/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:29.874333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.884465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c2-8a21-4b2c-bccc-bce58baddca9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.889054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.889699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.889975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.890249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] PATH_INFO: `/v3/projects/93a823c7b6e64be6a57b96cee7551f7f/users/4dfe597e0add46df8556475fbd4596df/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.895656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 809/1600] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:29.897573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.897858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.898135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.906085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a823c7b6e64be6a57b96cee7551f7f, user_id=4dfe597e0add46df8556475fbd4596df, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:29.908745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:29.923501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 792/1601] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:29 2022] PUT /identity/v3/projects/93a823c7b6e64be6a57b96cee7551f7f/users/4dfe597e0add46df8556475fbd4596df/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:29.927239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:29.927370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] MFA Rules not processed for user `ef69b4c27829488180e2d9ac5494e3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:29.927649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:29.982694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dc1c2-4284-4ae8-a017-28e2efd05117 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:29.986373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:29.986995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:29.987277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:29.987570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:29.992410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 810/1602] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:29.993294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.052261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.053880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.056135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba707f-d413-458a-9572-d1087e633686 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.060666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.061362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.061640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.061913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] PATH_INFO: `/v3/projects/4f41b647151843b3843b771c6beca7d3/users/d4591629719c4f05a013a8745cd371e5/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.063721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 793/1603] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:30.065464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.069844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.077136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f41b647151843b3843b771c6beca7d3, user_id=d4591629719c4f05a013a8745cd371e5, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.077656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d3730-1346-450d-a344-9d7bffdef7b0 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.079939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.082653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.084383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.085230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.085230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] PATH_INFO: `/v3/projects/81ff22d83f3f47c9bcf80fc2b400df43/users/52e3a0a6638a4e82820938488943c64b/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.094907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 811/1604] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:29 2022] PUT /identity/v3/projects/4f41b647151843b3843b771c6beca7d3/users/d4591629719c4f05a013a8745cd371e5/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:30.095703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.101230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ff22d83f3f47c9bcf80fc2b400df43, user_id=52e3a0a6638a4e82820938488943c64b, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.104180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.118604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 794/1605] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:30 2022] PUT /identity/v3/projects/81ff22d83f3f47c9bcf80fc2b400df43/users/52e3a0a6638a4e82820938488943c64b/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:30.119618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.171863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.185248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f886-10df-4c40-99f9-701d34dc44f9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.200562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b230126-c800-4866-98ae-c484efdcc348 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.206096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.207210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.207490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.207763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] PATH_INFO: `/v3/projects/4c5780c329a5465bb96915914dd905ba/users/8e523d7501c345fab9071f1075ed63eb/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.226876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5780c329a5465bb96915914dd905ba, user_id=8e523d7501c345fab9071f1075ed63eb, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.230605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.247762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 795/1606] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:30 2022] PUT /identity/v3/projects/4c5780c329a5465bb96915914dd905ba/users/8e523d7501c345fab9071f1075ed63eb/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:30.248561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.252224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.252928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.253246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.253526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] PATH_INFO: `/v3/projects/73dc6a0186a04e20a9a242e600a448fa/users/36ce2b6904ef4be4bea04cebcc2a5aaf/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.275325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dc6a0186a04e20a9a242e600a448fa, user_id=36ce2b6904ef4be4bea04cebcc2a5aaf, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.278135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ec57c-b2a0-43d9-ba80-119b9bce76c2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.293618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 812/1607] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:30 2022] PUT /identity/v3/projects/73dc6a0186a04e20a9a242e600a448fa/users/36ce2b6904ef4be4bea04cebcc2a5aaf/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:30.295040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.295328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.295602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.317186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:30.318966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:30.325460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d138-bd74-4b94-a976-61bb6534561c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.391861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.392483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.392758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.393052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.396549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 813/1608] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:30.396708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.396840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.396925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c372a-c216-41af-8fca-c10a3b62cdc0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.404937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdadcd-e3b0-4027-8e23-69368c87480f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.410262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.410914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.411195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.411462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.413158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.415568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3911623-8042-4bcc-b013-a5abf59fc397 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.432900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 796/1609] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:30.433902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada67-6d60-4f29-b860-2203e41c21f3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.433902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada67-6d60-4f29-b860-2203e41c21f3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.434205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada67-6d60-4f29-b860-2203e41c21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.438591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.454322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 814/1610] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:30.455706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d561-e69b-488c-9f1a-767d28897046 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.456329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d561-e69b-488c-9f1a-767d28897046 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.456664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d561-e69b-488c-9f1a-767d28897046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.467829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-39aada67-6d60-4f29-b860-2203e41c21f3 None None] MFA Rules not processed for user `d4591629719c4f05a013a8745cd371e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:30.469396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-39aada67-6d60-4f29-b860-2203e41c21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:30.487366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a0a9d561-e69b-488c-9f1a-767d28897046 None None] MFA Rules not processed for user `52e3a0a6638a4e82820938488943c64b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:30.488583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0a9d561-e69b-488c-9f1a-767d28897046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:30.517314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.556643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 797/1611] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:30.556643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.556643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.556643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.573113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:30.574481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:30.591997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 815/1612] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:30.594527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.595245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.596213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.622229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:30.623558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:30.649914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 798/1613] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:30.656690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.709476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 816/1614] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:30.710454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.726484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325cd3-cabf-455a-8e9b-8d26200f1b97 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.731848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.732474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c936b-f6ed-4aa7-b7ae-6118eb68e588 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.732598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.732906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.733267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.734083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.736083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.736209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.736766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.737076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.737350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.747492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.748936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.760286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 799/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:30.761097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.764661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 817/1616] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:30.765887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.770509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c6fa-03b9-43a4-b54f-e472b4cec604 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.776862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.777586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.777933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.778269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.778993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.779817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b881aab-329f-48bf-b058-870eded251ab admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.781092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409418e-11aa-43e8-935e-fbcfcb3e65c0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.785899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.786955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.787459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.787820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.788673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.791770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.810853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 800/1617] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:30.810853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89550-f632-4142-b152-09af1ac419cc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.810853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89550-f632-4142-b152-09af1ac419cc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.810853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89550-f632-4142-b152-09af1ac419cc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.812756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 801/1618] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 06:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:30.813531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89550-f632-4142-b152-09af1ac419cc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.828304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89550-f632-4142-b152-09af1ac419cc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.829167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 818/1619] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:30 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:30.830497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:30.893423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.898144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.899010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.899390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.899791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.902044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b2a13-5392-4589-a7bb-89af6650a2de admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:30.905818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:30.906444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:30.906725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:30.907148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:30.922987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:30.980350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.982080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.988338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:30.989881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:30.995378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 802/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:30.996230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.001905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 819/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:31.002742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.006715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d728215-d6a0-4d87-8c2f-bfd14657ad88 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.012313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.013190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.013646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.014078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.014934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.016749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0af76-2246-4ffd-964e-1b7b1146d3b6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.018607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0816-1f83-491d-a62e-60a05c52edd2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.026679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.028326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.028881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.029609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.030558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 803/1622] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.032082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.032373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.032697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.035243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.037868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.056318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 820/1623] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.058504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.074098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe48c6-35b3-4ca3-bacf-3dde9d0cbf6d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.080914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.081610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:31.082098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.082098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.082905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:31.083350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.085156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.087727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.121364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 821/1624] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:31 2022] POST /identity/v3/users => generated 306 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:31.123540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.143407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a0b1-7251-4571-b4fd-7a405c4cf6ad admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.156280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.157722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.158345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.158765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] PATH_INFO: `/v3/projects/8d42725ad7494a18ac470b8b3afe8516/users/bf194922da2845049a293e3ac13ad3f8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.179073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 804/1625] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 06:55:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:31.180464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d42725ad7494a18ac470b8b3afe8516, user_id=bf194922da2845049a293e3ac13ad3f8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.181097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.185154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.195458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83454c-9253-4911-9261-6d5fb8498390 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.202169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.203073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.203430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.203785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] PATH_INFO: `/v3/projects/89ce3d8ab1ab4753910de289fdb3a375/users/3ef12f29f8634e0693139d91f16504cc/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.209382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 822/1626] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/8d42725ad7494a18ac470b8b3afe8516/users/bf194922da2845049a293e3ac13ad3f8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.210636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.242628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ce3d8ab1ab4753910de289fdb3a375, user_id=3ef12f29f8634e0693139d91f16504cc, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.250760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.278476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 805/1627] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/89ce3d8ab1ab4753910de289fdb3a375/users/3ef12f29f8634e0693139d91f16504cc/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.280600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.350993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad5fbb-7fc3-4719-86eb-a3b89168a86b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.405279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:31.428666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3578-2ba4-444c-a6f9-9f5a8539a770 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.433377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:31.434796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.435440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.435719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.436116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.449348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.449983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.450564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.450949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.451657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.454151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.470422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 823/1628] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.471340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.488247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad44d-d821-4e95-a880-8e58ec670310 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.496350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.497464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.497464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.497686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.498329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.500123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.518156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 824/1629] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.519290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.534067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eb859-08e9-43f1-9e46-0bc96109e7d1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.534302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.536699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.539699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.540452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.540778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.541033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.541734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.544814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.561826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 825/1630] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.561826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.571356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 806/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:31.573311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4cbb-b238-4f2e-9929-ea216d0461a4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.573465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.578981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.579664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.580068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.580637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] PATH_INFO: `/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43/users/037b0ff043e14303a69900f30c9ee146/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.598535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06194ef-91f2-4ce9-b6c1-dbed54b1cbc7 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.604943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6420a4f57b7b4fb39a975322cb0e7f43, user_id=037b0ff043e14303a69900f30c9ee146, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.607950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.615477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.617012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.617012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.617404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] PATH_INFO: `/v3/projects/8d42725ad7494a18ac470b8b3afe8516/users/bf194922da2845049a293e3ac13ad3f8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.620151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d42725ad7494a18ac470b8b3afe8516, user_id=bf194922da2845049a293e3ac13ad3f8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.622886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.631333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 826/1632] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43/users/037b0ff043e14303a69900f30c9ee146/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.631333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.652155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 807/1633] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/8d42725ad7494a18ac470b8b3afe8516/users/bf194922da2845049a293e3ac13ad3f8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.653533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.716424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc595c07-8b1a-4e0e-9016-245c2c69edd0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.776185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6574e6-4602-49e3-9e6a-a62209d69b42 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.794254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.794912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.795243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.795666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.796968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.799178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d12cbd-ba65-4ed0-b1d8-fb9b0b1ac3c0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.820875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 808/1634] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:31.822585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e118-15f0-4ea0-8219-c00919581c8a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.822893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e118-15f0-4ea0-8219-c00919581c8a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.823142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e118-15f0-4ea0-8219-c00919581c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.838382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.839494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.840258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.840605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] PATH_INFO: `/v3/projects/89ce3d8ab1ab4753910de289fdb3a375/users/3ef12f29f8634e0693139d91f16504cc/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.843708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ce3d8ab1ab4753910de289fdb3a375, user_id=3ef12f29f8634e0693139d91f16504cc, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.851164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.865281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0344e118-15f0-4ea0-8219-c00919581c8a None None] MFA Rules not processed for user `bf194922da2845049a293e3ac13ad3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:31.867795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0344e118-15f0-4ea0-8219-c00919581c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:31.879631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 827/1635] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/89ce3d8ab1ab4753910de289fdb3a375/users/3ef12f29f8634e0693139d91f16504cc/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.885923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:31.944379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:31.968243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310692-67fe-4ef6-8bfb-576295f5b5e6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:31.975371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:31.975910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.976255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.976720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] PATH_INFO: `/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43/users/037b0ff043e14303a69900f30c9ee146/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:31.979442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6420a4f57b7b4fb39a975322cb0e7f43, user_id=037b0ff043e14303a69900f30c9ee146, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:31.984288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe898-6698-4648-8aae-086754a5642d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:31.997207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 828/1636] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:31 2022] PUT /identity/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43/users/037b0ff043e14303a69900f30c9ee146/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:31.998835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893313-7dcf-461a-ab23-9c397327f73b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:31.999208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893313-7dcf-461a-ab23-9c397327f73b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:31.999571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893313-7dcf-461a-ab23-9c397327f73b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.001262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 829/1637] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 06:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:32.002598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606c23-9477-4f36-af7e-983f6cb29199 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.002982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606c23-9477-4f36-af7e-983f6cb29199 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.003323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606c23-9477-4f36-af7e-983f6cb29199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.034966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 809/1638] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:32.038006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a3606c23-9477-4f36-af7e-983f6cb29199 None None] MFA Rules not processed for user `3ef12f29f8634e0693139d91f16504cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:32.039456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a3606c23-9477-4f36-af7e-983f6cb29199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:32.041116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.041423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.041868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.064011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:32.080019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:32.081373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:32.140075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 830/1639] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:32.140075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.140075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.140075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.183140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 810/1640] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:32.183998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:32.205255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] MFA Rules not processed for user `037b0ff043e14303a69900f30c9ee146`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:32.209117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:32.260925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f930d9-c554-4bf5-bfed-d31b0c7eb3fd None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:32.266307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:32.267793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.267793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.268031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.351972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 831/1641] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:32.352860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:32.367198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960d6f-ed59-4257-943b-2febde553e92 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:32.372733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:32.373589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.374607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.375153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.377045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:32.378605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eddc5-b483-49ee-8b6d-902b71a591ec service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:32.389796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:32.394013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a34ebb-d128-4561-ae2d-00e631d9f0ff service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:32.397024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 811/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:32.398455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af2ef-7a4c-4d2c-860a-958abfbca933 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.398747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af2ef-7a4c-4d2c-860a-958abfbca933 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.399056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af2ef-7a4c-4d2c-860a-958abfbca933 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.400893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 812/1643] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 06:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:32.407768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.408072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.408411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.413692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 832/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:32.455008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:32.456235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:32.476479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 813/1645] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:55:32.487888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efd0d-d887-4175-bd40-3dfcab33892c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.488334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efd0d-d887-4175-bd40-3dfcab33892c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.488882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efd0d-d887-4175-bd40-3dfcab33892c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.493473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 833/1646] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 06:55:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:32.501197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:32.504599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.505414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.506189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.553174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b457d2f-c0c2-42f9-a333-9e62641935dd None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:32.567015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:32.569000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:32.576039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:32.576687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.577011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.577255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.582593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 834/1647] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:32.584118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:32.596658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:32.598588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:32.613027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 814/1648] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:32.614174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50071-68de-4030-9a51-9ef8d1982711 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:32.618779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:32.619418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.619681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.619954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.644628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:32.646113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:32.665174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 835/1649] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:32.852406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:32.862978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f76b-175e-4363-8ca8-9d12c9349253 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:32.869015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:32.874256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:32.875031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:32.875637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:32.951871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:33.055907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:33.061855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:33.085989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 815/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:33.134899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:33.165748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfd130-785b-4648-b0e3-ba4d17ce23ba service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:33.176542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:33.178209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:33.178209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:33.178668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:33.197191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:33.198731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:33.208250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:33.229746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 836/1651] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:33.399312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:33.420489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b6e5-c932-4658-b4a1-90beacac72cc service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:33.427174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:33.428750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:33.429193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:33.429596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:33.532927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:33.535387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:33.556609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 816/1652] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:33.888133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:33.928731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ee1a-b3ae-4e1e-a6ee-6eb346e7d4b1 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:33.948023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:33.948856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:33.949283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:33.949685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:34.046755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:34.048344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db99594-b134-4f15-adb6-79c1ce3426d5 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:34.061212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 837/1653] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:36.328144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:36.521083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcedac-8f95-4d77-b9ba-7b034610a0bf service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:36.532945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:36.539603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:36.545275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:36.545754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] PATH_INFO: `/v3/users/52e3a0a6638a4e82820938488943c64b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:36.549677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e3a0a6638a4e82820938488943c64b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:36.552696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: WARNING py.warnings [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:36.552696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: warnings.warn(msg) Aug 04 06:55:36.552696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: Aug 04 06:55:36.556051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:36.703013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e3a0a6638a4e82820938488943c64b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:36.704070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e3a0a6638a4e82820938488943c64b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:36.725778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e3a0a6638a4e82820938488943c64b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:36.726312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e3a0a6638a4e82820938488943c64b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:36.766894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:36.788144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e3a0a6638a4e82820938488943c64b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:36.815247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 817/1654] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:36 2022] DELETE /identity/v3/users/52e3a0a6638a4e82820938488943c64b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:36.817303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:36.817762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:36.817762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:36.867651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:36.871447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:37.034249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 838/1655] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:37.071728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:37.074859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:37.264181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a68217-4923-4ffb-bebd-4a2738112007 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:37.281467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:37.282470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:37.282888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:37.283318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:37.315105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:37.317096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5935-ea23-4eca-9ca1-636ab2047720 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:37.332025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 818/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:38.794259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:38.795985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:38.824132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9cc13-b29b-4dab-8248-e4c078359b63 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:38.847502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:38.861950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:38.869536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:38.869823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] PATH_INFO: `/v3/users/8d166fbb12a44ce6a8b992144b06d9cc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:38.872072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d166fbb12a44ce6a8b992144b06d9cc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:38.874231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:38.979425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d166fbb12a44ce6a8b992144b06d9cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:38.980215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d166fbb12a44ce6a8b992144b06d9cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:38.981199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d166fbb12a44ce6a8b992144b06d9cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:38.999145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d166fbb12a44ce6a8b992144b06d9cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.022744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d166fbb12a44ce6a8b992144b06d9cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.049165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 839/1657] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:38 2022] DELETE /identity/v3/users/8d166fbb12a44ce6a8b992144b06d9cc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:55:39.051021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.051472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.054098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.094907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:39.102145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:39.217037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:39.218518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:39.243412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:39.319590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 819/1658] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:39.343418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:39.345985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:39.363905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7be96-f8db-4cfd-9110-263613636861 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:39.389695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:39.390801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.392498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.393114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] PATH_INFO: `/v3/projects/81ff22d83f3f47c9bcf80fc2b400df43` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.397229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ff22d83f3f47c9bcf80fc2b400df43)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:39.399499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: WARNING py.warnings [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 06:55:39.399499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: warnings.warn(msg) Aug 04 06:55:39.399499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: Aug 04 06:55:39.400742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:39.529421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac3900-f707-4119-af9f-5f8a87b49862 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:39.565115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ff22d83f3f47c9bcf80fc2b400df43', 'request_id': 'req-b174349c-afcb-4fca-a7f1-ccb7968541cb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.586262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ff22d83f3f47c9bcf80fc2b400df43', 'request_id': 'req-b174349c-afcb-4fca-a7f1-ccb7968541cb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.603326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:39.613006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ff22d83f3f47c9bcf80fc2b400df43', 'request_id': 'req-b174349c-afcb-4fca-a7f1-ccb7968541cb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.632616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:39.633716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.634140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.635439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.661440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] The token cache is being invalidate because project 81ff22d83f3f47c9bcf80fc2b400df43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:39.661796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.662664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b174349c-afcb-4fca-a7f1-ccb7968541cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:39.669965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 840/1659] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:39 2022] DELETE /identity/v3/projects/81ff22d83f3f47c9bcf80fc2b400df43 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:55:39.672919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.673249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.673525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.718743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:39.723025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:39.750888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:39.753111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a5b46-b4ab-4f12-b8b4-d3140851affe service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:39.769503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 820/1660] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:39.847125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 841/1661] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:39.848601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.848897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.849248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.882060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:39.884559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:39.899887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 821/1662] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:39.903759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:39.914836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a096-f5a3-43e4-b665-29d89f0e4f1f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:39.930622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:39.931279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:39.931560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:39.931832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:39.932535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:39.932836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:39.934475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:39.976894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:39.986208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 842/1663] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:39.988303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de69cdc-9735-4bc3-b9e4-8f5482e34053 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.003227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.005176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.006282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.006921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.008496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.011201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:40.078124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 822/1664] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:39 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:40.082025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:40.097737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bb58-ee9a-4cad-8d02-de5eb0aa28d4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.151253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:40.226635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.227996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.228280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.228552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.229246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.231182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:40.273239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 843/1665] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:40 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:40.277374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:40.298080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b93-0c8d-411b-88c8-0dd92b00a8d4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.307842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.316146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.316432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.316708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.317468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.319905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:40.349458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 823/1666] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:40.350863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:40.367027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911cca5-b9b0-4572-89ec-ba3a17085a8b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.381500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.382760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.383224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.383685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.384911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.389366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826cf57-f527-4582-9237-c4a837d18e34 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:40.415714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 844/1667] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:40.419984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:40.435330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2178f3-82b2-464e-a405-77a11ce710d0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.445386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.446088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.446367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.446642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] PATH_INFO: `/v3/projects/1ef9aff795b14a689fcf13e1ec91a8e7/users/0cca783406524473b02d25c6f841667d/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.483642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef9aff795b14a689fcf13e1ec91a8e7, user_id=0cca783406524473b02d25c6f841667d, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.486362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:40.517320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 824/1668] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:40 2022] PUT /identity/v3/projects/1ef9aff795b14a689fcf13e1ec91a8e7/users/0cca783406524473b02d25c6f841667d/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:40.518810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.519103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.519382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.592612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] MFA Rules not processed for user `0cca783406524473b02d25c6f841667d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:40.594226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:40.801521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 845/1669] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:40.806263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:40.970695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2df82-9b2f-413f-b8e4-118221b9c47c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:40.989396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:40.990373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:40.990771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:40.990972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:40.991616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:40.993589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.054705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 825/1670] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:40 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:41.056622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:41.075167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc62f0-b973-46da-98a7-18506673a5a4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:41.267085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:41.268025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.268525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.269020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.269891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:41.272699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.301211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 846/1671] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:41 2022] POST /identity/v3/users => generated 308 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:41.305837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:41.320333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646248-442a-49b0-9a13-090996d5c007 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:41.326125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:41.326932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.327364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.327834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.329133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:41.331026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.349353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:41.350127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 826/1672] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:41.361644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b485-f30c-41c6-8ba8-bb0afa14cf59 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:41.374163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:41.375454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.376360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.376839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] PATH_INFO: `/v3/projects/dd1df6dd0c4d4342a1012ba266cab496/users/0fa0da09889d4323a7edc29656544b17/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.418116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1df6dd0c4d4342a1012ba266cab496, user_id=0fa0da09889d4323a7edc29656544b17, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:41.423014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.456902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 847/1673] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:41 2022] PUT /identity/v3/projects/dd1df6dd0c4d4342a1012ba266cab496/users/0fa0da09889d4323a7edc29656544b17/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:55:41.458380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:41.467004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:41.490711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8573-056b-498e-acb7-6755543eb725 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:41.669630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:41.670280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.670573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.671191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.671671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:41.673738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9227a-bdbf-497a-860b-dc69ac50de51 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.716508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 827/1674] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:41.723116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:41.736171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:41.755062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be9d9-c03e-4ce4-96f9-ae131710be01 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:41.764080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:41.765146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.767548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.768172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] PATH_INFO: `/v3/projects/dd1df6dd0c4d4342a1012ba266cab496/users/0fa0da09889d4323a7edc29656544b17/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.774166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1df6dd0c4d4342a1012ba266cab496, user_id=0fa0da09889d4323a7edc29656544b17, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:41.778224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:41.793560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 848/1675] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:41 2022] PUT /identity/v3/projects/dd1df6dd0c4d4342a1012ba266cab496/users/0fa0da09889d4323a7edc29656544b17/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:41.805753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc127-8351-4be6-9f0d-0b7683987d54 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:41.806039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc127-8351-4be6-9f0d-0b7683987d54 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:41.806315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc127-8351-4be6-9f0d-0b7683987d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:41.871575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f99cc127-8351-4be6-9f0d-0b7683987d54 None None] MFA Rules not processed for user `0fa0da09889d4323a7edc29656544b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:41.873521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f99cc127-8351-4be6-9f0d-0b7683987d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:42.058096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 828/1676] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:42.070674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:42.072476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:42.209321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6fb6-1088-4224-be85-8a7fb8b061d8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:42.220309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:42.221253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:42.221701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:42.222166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:42.252548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:42.254459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:42.313925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 849/1677] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:42 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:42.518724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:42.520279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:42.520638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:42.617871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] MFA Rules not processed for user `36ce2b6904ef4be4bea04cebcc2a5aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:42.625694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:42.698813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:42.700295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:42.753024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 829/1678] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:42.772391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:42.780072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:42.841010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:42.974698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79a588-5b7c-4386-b40c-a8eb862289d4 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:42.988963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:42.989804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:42.990231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:42.990569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] PATH_INFO: `/v3/projects/54ddd1a45bb94faf8b30e184f42d7d46` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:42.994095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ddd1a45bb94faf8b30e184f42d7d46)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:43.004435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:43.080083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56369a-a0aa-42aa-a1c1-4094e439b4ec None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:43.105794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:43.106454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:43.106729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:43.107007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:43.149414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:43.151124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:43.199001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 830/1679] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:55:43.200153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:43.207797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ddd1a45bb94faf8b30e184f42d7d46', 'request_id': 'req-f9f2c6d7-473e-46f1-b095-91b45dc66788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.210887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:43.228675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ddd1a45bb94faf8b30e184f42d7d46', 'request_id': 'req-f9f2c6d7-473e-46f1-b095-91b45dc66788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.266575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ddd1a45bb94faf8b30e184f42d7d46', 'request_id': 'req-f9f2c6d7-473e-46f1-b095-91b45dc66788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.276752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3c2a-9ce8-4340-ad9e-eb223544d6f3 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:43.341331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] The token cache is being invalidate because project 54ddd1a45bb94faf8b30e184f42d7d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:43.341657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.343013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.345459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 850/1680] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:42 2022] DELETE /identity/v3/projects/54ddd1a45bb94faf8b30e184f42d7d46 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:43.346383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:43.348608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:43.459878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:43.535261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:43.535928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:43.536362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:43.536890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] PATH_INFO: `/v3/users/d4591629719c4f05a013a8745cd371e5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:43.542128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4591629719c4f05a013a8745cd371e5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:43.544100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:43.611631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c6d7-473e-46f1-b095-91b45dc66788 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:43.631040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:43.631040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:43.633534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:43.637669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] PATH_INFO: `/v3/users/0cca783406524473b02d25c6f841667d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:43.643659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cca783406524473b02d25c6f841667d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:43.650086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:43.745518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4591629719c4f05a013a8745cd371e5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.748712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4591629719c4f05a013a8745cd371e5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.774084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4591629719c4f05a013a8745cd371e5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.774863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4591629719c4f05a013a8745cd371e5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.797079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cca783406524473b02d25c6f841667d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.799170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cca783406524473b02d25c6f841667d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.802031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cca783406524473b02d25c6f841667d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.822262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4591629719c4f05a013a8745cd371e5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.824446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cca783406524473b02d25c6f841667d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.867253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 831/1681] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:43 2022] DELETE /identity/v3/users/d4591629719c4f05a013a8745cd371e5 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:43.868173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:43.872221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1ca84598-d8d1-4011-94d5-d548df367955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cca783406524473b02d25c6f841667d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:43.877246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:43.947879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 851/1682] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:43 2022] DELETE /identity/v3/users/0cca783406524473b02d25c6f841667d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:43.952531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c01da3-af16-4c1c-9e2c-07432e6057e8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:43.953175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c01da3-af16-4c1c-9e2c-07432e6057e8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:43.954620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c01da3-af16-4c1c-9e2c-07432e6057e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:43.966322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:44.023510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d1c01da3-af16-4c1c-9e2c-07432e6057e8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:44.024759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d1c01da3-af16-4c1c-9e2c-07432e6057e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:44.082325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9863cb-4949-4c02-a94e-082745bd2177 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:44.252407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:44.253147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:44.253448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:44.253728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] PATH_INFO: `/v3/users/bf194922da2845049a293e3ac13ad3f8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:44.255034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf194922da2845049a293e3ac13ad3f8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:44.257644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:44.318252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 852/1683] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:44.324144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:44.324578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:44.325385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:44.405516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf194922da2845049a293e3ac13ad3f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:44.406913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf194922da2845049a293e3ac13ad3f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:44.429694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf194922da2845049a293e3ac13ad3f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:44.430704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf194922da2845049a293e3ac13ad3f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:44.457890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] MFA Rules not processed for user `4dfe597e0add46df8556475fbd4596df`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:44.459906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:44.475224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e2d0a257-b126-4ff7-81b9-23966c91bda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf194922da2845049a293e3ac13ad3f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:44.518394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 832/1684] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:43 2022] DELETE /identity/v3/users/bf194922da2845049a293e3ac13ad3f8 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:44.526375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb98a-818f-43d3-9ddd-139d4a32f825 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:44.527380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb98a-818f-43d3-9ddd-139d4a32f825 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:44.527756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb98a-818f-43d3-9ddd-139d4a32f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:44.566920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:44.588419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-00ecb98a-818f-43d3-9ddd-139d4a32f825 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:44.590113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-00ecb98a-818f-43d3-9ddd-139d4a32f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:44.664730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 853/1685] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:44.668807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:44.672316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:44.723107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:44.768024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 833/1686] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:44.770971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b85d-d170-458d-bf65-69bfd3fdbf34 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:44.772013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b85d-d170-458d-bf65-69bfd3fdbf34 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:44.773283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b85d-d170-458d-bf65-69bfd3fdbf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:44.831140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9435ce0-9c66-4492-adb7-28e60d80fd91 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:44.872135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5501b85d-d170-458d-bf65-69bfd3fdbf34 None None] MFA Rules not processed for user `8e523d7501c345fab9071f1075ed63eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:44.873671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5501b85d-d170-458d-bf65-69bfd3fdbf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.006876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.009249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.009584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.009863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.014366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.049129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 834/1687] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:45.061003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.062142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.063989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.076341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.080922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:45.104148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] MFA Rules not processed for user `4dfe597e0add46df8556475fbd4596df`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:45.104542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 854/1688] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:45.105765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:45.107633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.118907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5901d2-12fa-4018-8dc3-ecaf79636dcb service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:45.127102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.128174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.128727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.129945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.155261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.159256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60401cde-a3b0-4598-949f-54914b2a84f9 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:45.190408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 855/1689] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:45.199554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.199847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.200121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.257559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] MFA Rules not processed for user `8e523d7501c345fab9071f1075ed63eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:45.261911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.276607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 835/1690] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:45.278613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:45.280347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.288231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 856/1691] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:45.296167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:45.298510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.298793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6a14d-4625-4262-8bf7-530ddcb04107 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:45.306261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.307226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.307508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.307872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] PATH_INFO: `/v3/projects/8d42725ad7494a18ac470b8b3afe8516` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.309808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d42725ad7494a18ac470b8b3afe8516)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.312642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:45.392109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d42725ad7494a18ac470b8b3afe8516', 'request_id': 'req-bab15eff-37b2-4f7c-b285-8d34066987ba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:45.405217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d42725ad7494a18ac470b8b3afe8516', 'request_id': 'req-bab15eff-37b2-4f7c-b285-8d34066987ba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:45.416474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d42725ad7494a18ac470b8b3afe8516', 'request_id': 'req-bab15eff-37b2-4f7c-b285-8d34066987ba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:45.439191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] The token cache is being invalidate because project 8d42725ad7494a18ac470b8b3afe8516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:45.439508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:45.440163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:45.446118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 836/1692] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:45 2022] DELETE /identity/v3/projects/8d42725ad7494a18ac470b8b3afe8516 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:45.446118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:45.450562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.462643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:45.491877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b3e6-c562-4af6-af57-c397d2a5ce48 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:45.506180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:45.617954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15eff-37b2-4f7c-b285-8d34066987ba admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:45.627371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.629137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.629595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.629874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.634093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.649730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.650512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.651063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.651344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.654094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.738151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.741260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1a1e9-e7c3-4897-b412-ee68f1ef3b56 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:45.765483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 837/1693] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:45.767422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532132-d0ba-4952-bd6f-0d1267d20963 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.768087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532132-d0ba-4952-bd6f-0d1267d20963 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.768087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532132-d0ba-4952-bd6f-0d1267d20963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.775304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.777452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:45.789455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 857/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:45.790471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:45.791931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.839296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-68532132-d0ba-4952-bd6f-0d1267d20963 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:45.840542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-68532132-d0ba-4952-bd6f-0d1267d20963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:45.885923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3536ab-c3b2-4592-882e-8234eb9fe832 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:45.914368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:45.916281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:45.918507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:45.918910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] PATH_INFO: `/v3/users/a20eec282155471781c18b212b96e4d0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:45.921232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20eec282155471781c18b212b96e4d0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:45.923734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.045686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 838/1695] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:46.048381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20eec282155471781c18b212b96e4d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.048535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.050228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20eec282155471781c18b212b96e4d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.051093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20eec282155471781c18b212b96e4d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.055593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.055593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.056268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:46.072837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20eec282155471781c18b212b96e4d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.110953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:46.112209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.115572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d3ecf69-72bc-4cf7-b165-93ce96112de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20eec282155471781c18b212b96e4d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.135016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 839/1696] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:46.139951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.145974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 858/1697] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:45 2022] DELETE /identity/v3/users/a20eec282155471781c18b212b96e4d0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:46.150995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.153564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.153911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.159472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f93ff-012f-4b4b-99c7-f0af77067164 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.204033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:46.207187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.209725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:46.273800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.274559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.274988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.276900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.278914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:46.279582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.284751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.314266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 840/1698] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:55:46.316089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.321658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.356142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a061d31-5e16-4029-8593-fa15a4289f6c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.363628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 859/1699] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:46.363628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.371566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.372393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.372777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.373303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] PATH_INFO: `/v3/users/ef69b4c27829488180e2d9ac5494e3fa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.378456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef69b4c27829488180e2d9ac5494e3fa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.385033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.385551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00fe2f-c71a-4c0d-ac60-56356928f79c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.401278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.402010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.402397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.402772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.403700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.407449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.472157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 860/1700] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:46 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:46.475470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.480831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.506663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef69b4c27829488180e2d9ac5494e3fa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.507788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef69b4c27829488180e2d9ac5494e3fa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.518733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef69b4c27829488180e2d9ac5494e3fa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.519829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef69b4c27829488180e2d9ac5494e3fa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.559419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef69b4c27829488180e2d9ac5494e3fa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:46.612834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 841/1701] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:46 2022] DELETE /identity/v3/users/ef69b4c27829488180e2d9ac5494e3fa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:46.617080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.620411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.639917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae9787-0305-4df1-8874-ff6a08d0165b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.767038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.767687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.768343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.768642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.772911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.788221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.790866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f7c00-e3e1-46db-a8dc-7a09f8f8d51b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.800391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2caf9-b888-471f-9b26-e91463f30729 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.807127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 861/1702] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:46.809046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.809346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.809669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.819417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:46.830186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.830842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.831119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.831370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.832046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.834234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d732dc-2bf7-4eab-a48b-50f765aa1bd4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.847196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:46.848407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.890650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 842/1703] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:46 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:46.890650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.890650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.890650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.895561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 843/1704] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 06:55:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:46.896453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.898556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 862/1705] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:46.899632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:46.900284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.901054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:46.939278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c60c1-9d81-4515-9404-d24a475c418c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.950027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a5bc-0b1d-44f1-add4-f6a4166e7baa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:46.953810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.956197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.956493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.956776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] PATH_INFO: `/v3/projects/4f41b647151843b3843b771c6beca7d3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.962406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:46.963083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:46.963359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:46.963683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] PATH_INFO: `/v3/projects/1ef9aff795b14a689fcf13e1ec91a8e7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:46.965812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef9aff795b14a689fcf13e1ec91a8e7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.967922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f41b647151843b3843b771c6beca7d3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:46.970082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:46.973598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.023724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:47.063885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef9aff795b14a689fcf13e1ec91a8e7', 'request_id': 'req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.071453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef9aff795b14a689fcf13e1ec91a8e7', 'request_id': 'req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.085718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef9aff795b14a689fcf13e1ec91a8e7', 'request_id': 'req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.098442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f41b647151843b3843b771c6beca7d3', 'request_id': 'req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.106306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] The token cache is being invalidate because project 1ef9aff795b14a689fcf13e1ec91a8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:47.106623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.107892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.111010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 863/1706] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:46 2022] DELETE /identity/v3/projects/1ef9aff795b14a689fcf13e1ec91a8e7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:47.111576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f41b647151843b3843b771c6beca7d3', 'request_id': 'req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.112322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.115392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.128710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f41b647151843b3843b771c6beca7d3', 'request_id': 'req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.158570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] The token cache is being invalidate because project 4f41b647151843b3843b771c6beca7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:47.158865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.159560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c52f5a2b-6045-4f20-a73b-6d5231a2c5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.168744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 844/1707] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:46 2022] DELETE /identity/v3/projects/4f41b647151843b3843b771c6beca7d3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:47.170164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.170455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.170733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.233175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:47.234529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.252492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5caf2-a6df-4059-b4cf-7bfca5c3ec70 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.345332 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 845/1708] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:55:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:47.348043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.354652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.354880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.361737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.362107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.362589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.363383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.366819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30028417-bfb9-4aee-ab93-ebcbe63733a8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.383021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 864/1709] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:47.383021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.383021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.383021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.384357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 865/1710] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 06:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:47.385152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.387661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.391568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94faa52-9e21-4702-ad5c-379208ab3d31 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.401238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.402208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.403110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.403643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.404551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f9e6-fe63-4c6d-8bcb-a943571ffa19 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.407229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.409925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.410592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.410872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.411538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] PATH_INFO: `/v3/users/0fa0da09889d4323a7edc29656544b17` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.412620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa0da09889d4323a7edc29656544b17)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.415113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.437495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:47.463433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.465330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.490763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 846/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:47.492026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.492607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa0da09889d4323a7edc29656544b17'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.493883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa0da09889d4323a7edc29656544b17'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.494875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa0da09889d4323a7edc29656544b17'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.495856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.511022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa0da09889d4323a7edc29656544b17'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.521516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be27d58-53b5-4dd8-a40b-201430cf429d service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.534055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.535780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.536078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.537338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] PATH_INFO: `/v3/users/037b0ff043e14303a69900f30c9ee146` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.539564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa0da09889d4323a7edc29656544b17'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.540811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=037b0ff043e14303a69900f30c9ee146)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.544323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.565012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 866/1712] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:47 2022] DELETE /identity/v3/users/0fa0da09889d4323a7edc29656544b17 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:47.566907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.572472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.660432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037b0ff043e14303a69900f30c9ee146'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.662666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037b0ff043e14303a69900f30c9ee146'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.686641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ef-cc11-4f54-9115-cd1aae5d7ef9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.693450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.694803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.695099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.695375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.696392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.698076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1613-d0bc-445b-9f37-35407dca6262 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:47.711527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037b0ff043e14303a69900f30c9ee146'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.713439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037b0ff043e14303a69900f30c9ee146'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.723137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 867/1713] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:47.725402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.726438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.726438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.744100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037b0ff043e14303a69900f30c9ee146'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:47.769460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 847/1714] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:47 2022] DELETE /identity/v3/users/037b0ff043e14303a69900f30c9ee146 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:47.770441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.774409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.778549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:47.780893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.796898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:47.931538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 868/1715] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:55:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:47.933894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:47.936796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.939523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ea4b-f19d-4e03-9975-6bf8d384d8ed admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:47.952661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:47.953337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:47.953644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:47.953877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:47.963001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:47.994355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:47.995817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.028769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 848/1716] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:48.033389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:48.036159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.050748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:48.122111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734ef4-b919-47fd-868b-c080dfbb51ea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:48.133616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:48.135726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.136004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.136273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] PATH_INFO: `/v3/projects/3304921d3a6e4ec6a02b21cc8bd252e8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.141529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3304921d3a6e4ec6a02b21cc8bd252e8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:48.147243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.179995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39440dc-0091-4861-adbb-51aed165ee35 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:48.192541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:48.193874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.194173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.194459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] PATH_INFO: `/v3/projects/80f6573dc16745418853f33fb100922f/users/c36d8827781c46acb981fd7fc9c1882c/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.229372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f6573dc16745418853f33fb100922f, user_id=c36d8827781c46acb981fd7fc9c1882c, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:48.232331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31293f8b-d0b6-47a3-a470-f357d9f7dd0a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.270087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 849/1717] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:48 2022] PUT /identity/v3/projects/80f6573dc16745418853f33fb100922f/users/c36d8827781c46acb981fd7fc9c1882c/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:48.273295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f6f9-fcaf-4601-af13-5fd13a9a3a0b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.273591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f6f9-fcaf-4601-af13-5fd13a9a3a0b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.273867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f6f9-fcaf-4601-af13-5fd13a9a3a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.285181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3304921d3a6e4ec6a02b21cc8bd252e8', 'request_id': 'req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:48.304551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3304921d3a6e4ec6a02b21cc8bd252e8', 'request_id': 'req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:48.315714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3961f6f9-fcaf-4601-af13-5fd13a9a3a0b None None] MFA Rules not processed for user `36ce2b6904ef4be4bea04cebcc2a5aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:48.317107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3961f6f9-fcaf-4601-af13-5fd13a9a3a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.324646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3304921d3a6e4ec6a02b21cc8bd252e8', 'request_id': 'req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:48.351226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] The token cache is being invalidate because project 3304921d3a6e4ec6a02b21cc8bd252e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:48.351562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:48.353539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:48.366586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 869/1718] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:47 2022] DELETE /identity/v3/projects/3304921d3a6e4ec6a02b21cc8bd252e8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:48.369134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:48.372463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.487825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 850/1719] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:48.490352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.492709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7719d5-c33f-4d5c-ad92-25bb0a3a88f4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:48.492974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.493472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.582692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:48.583422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.583861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.584138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.586501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.590328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] MFA Rules not processed for user `c36d8827781c46acb981fd7fc9c1882c`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:48.591507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.606648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:48.608784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2fc6-bedc-4b99-8ab8-b72f2c2949f1 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.621522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 870/1720] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:48.621967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.622256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.622534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.658015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:48.659900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.670119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:48.747378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:48.789461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 851/1721] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:48.790492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:48.792510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.818712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 871/1722] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:48.820183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:48.826320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:48.852662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529033-c70f-40b7-a052-f585d37b06ca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:48.874267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:48.875590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.875966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.876314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.877098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:48.879500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afe30-20ca-4c15-ac56-b594ac7ec894 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.930500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1b61-eb04-4cd4-bc26-1b451f95e96c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:48.938855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:48.940046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.940518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.941040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] PATH_INFO: `/v3/projects/1cb16b89aa804519b731998a240078bf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.941157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 872/1723] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:48 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:48.942660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:48.942881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb16b89aa804519b731998a240078bf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:48.943297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:48.944129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:48.945792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:48.990876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:48.992459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.050658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb16b89aa804519b731998a240078bf', 'request_id': 'req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.058173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb16b89aa804519b731998a240078bf', 'request_id': 'req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.071054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb16b89aa804519b731998a240078bf', 'request_id': 'req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.101558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] The token cache is being invalidate because project 1cb16b89aa804519b731998a240078bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:49.101785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.102664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.114649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 852/1724] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:48 2022] DELETE /identity/v3/projects/1cb16b89aa804519b731998a240078bf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:49.115605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.116716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 873/1725] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:49.117728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.120808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.122008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.146513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef2c2a-c059-45ed-9709-acdd7942f50f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:49.287353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:49.293391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:49.294430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:49.294762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:49.295217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] PATH_INFO: `/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:49.300499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f9fc-2626-40a4-9f3a-c2ceea83dfee admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:49.300962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6420a4f57b7b4fb39a975322cb0e7f43)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:49.307591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:49.308835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:49.309513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:49.309792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:49.310060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:49.310729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:49.317294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:49.386658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 853/1726] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:49 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:49.386658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.387516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.423671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371c79-27f4-4101-bd5d-39b3883d0ba5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:49.470810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6420a4f57b7b4fb39a975322cb0e7f43', 'request_id': 'req-b5349ec0-faea-4719-b72a-41d5eb3f88ed'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.472337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:49.498212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6420a4f57b7b4fb39a975322cb0e7f43', 'request_id': 'req-b5349ec0-faea-4719-b72a-41d5eb3f88ed'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.513924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6420a4f57b7b4fb39a975322cb0e7f43', 'request_id': 'req-b5349ec0-faea-4719-b72a-41d5eb3f88ed'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.540655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] The token cache is being invalidate because project 6420a4f57b7b4fb39a975322cb0e7f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:49.540942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.544403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.548794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 874/1727] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:49 2022] DELETE /identity/v3/projects/6420a4f57b7b4fb39a975322cb0e7f43 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:49.555924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.558056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.621373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:49.621373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:49.621373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:49.621373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] PATH_INFO: `/v3/users/3ef12f29f8634e0693139d91f16504cc` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:49.621676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef12f29f8634e0693139d91f16504cc)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:49.624579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:49.774004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349ec0-faea-4719-b72a-41d5eb3f88ed admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:49.778445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef12f29f8634e0693139d91f16504cc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.779510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef12f29f8634e0693139d91f16504cc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.789655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:49.790436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:49.791351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:49.791645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:49.792378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:49.792691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:49.794378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:49.800440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef12f29f8634e0693139d91f16504cc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.803765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef12f29f8634e0693139d91f16504cc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.836785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef12f29f8634e0693139d91f16504cc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:49.846775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 875/1728] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:49.848996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.853357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.874620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 854/1729] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:49 2022] DELETE /identity/v3/users/3ef12f29f8634e0693139d91f16504cc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:49.877252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:49.883142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2def-5893-4c3d-b4cd-3a55180e0981 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:49.900921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:49.998566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:49.999292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:49.999524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:49.999812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] PATH_INFO: `/v3/projects/dd1df6dd0c4d4342a1012ba266cab496` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.004895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1df6dd0c4d4342a1012ba266cab496)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:50.008530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:50.057710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df916a-ecc5-4789-b1d5-11aa540db290 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:50.069037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:50.072570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.073334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.074222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.075542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:50.078740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d118acd-d8b5-48c6-84b3-cb22bdca00d6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:50.102882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 855/1730] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:50.106016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.106899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.107388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.116386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1df6dd0c4d4342a1012ba266cab496', 'request_id': 'req-99b2e72e-6011-4119-aa5f-974756a03ac7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:50.122004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:50.129802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1df6dd0c4d4342a1012ba266cab496', 'request_id': 'req-99b2e72e-6011-4119-aa5f-974756a03ac7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:50.146981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1df6dd0c4d4342a1012ba266cab496', 'request_id': 'req-99b2e72e-6011-4119-aa5f-974756a03ac7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:50.154120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:50.156486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.175295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] The token cache is being invalidate because project dd1df6dd0c4d4342a1012ba266cab496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:50.175610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:50.178500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99b2e72e-6011-4119-aa5f-974756a03ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:50.181554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 876/1731] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:49 2022] DELETE /identity/v3/projects/dd1df6dd0c4d4342a1012ba266cab496 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:50.182597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.182880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.183164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.189366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 877/1732] 10.222.0.36 () {54 vars in 961 bytes} [Thu Aug 4 06:55:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:55:50.190261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:50.193914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.214725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:50.337663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 856/1733] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:50.340068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:50.345914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.363950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755925b5-ad08-4953-97b0-0b8b130a2141 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:50.376383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c9b0-6ac9-4bd4-93bd-c4dd74486e07 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:50.376598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:50.377206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.377497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.377779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.379799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.389536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:50.390298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.390570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.390848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.391961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:50.396284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:50.402945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:50.408101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff61f-61d2-4a6e-8d35-02bf94f5c082 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:50.440551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 878/1734] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:50.446234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919889b-12b9-4ba4-84a5-53069bd47767 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.448468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919889b-12b9-4ba4-84a5-53069bd47767 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.450445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919889b-12b9-4ba4-84a5-53069bd47767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.457131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 857/1735] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:50 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:50.461896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:50.467688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.510619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b919889b-12b9-4ba4-84a5-53069bd47767 None None] MFA Rules not processed for user `4dfe597e0add46df8556475fbd4596df`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:50.513995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b919889b-12b9-4ba4-84a5-53069bd47767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.671571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c898-5372-48b0-987b-72ea6a713176 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:50.690231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 879/1736] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:50.691486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:50.692186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.692470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.693308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] PATH_INFO: `/v3/projects/d641385c4e8143fc8137dff94e6ca89b/users/b8f272c6fe444c398be467df482538bd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.693545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b080-dd4a-46a5-bfcf-0050145fc51c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.693789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b080-dd4a-46a5-bfcf-0050145fc51c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.694153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b080-dd4a-46a5-bfcf-0050145fc51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.756479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d641385c4e8143fc8137dff94e6ca89b, user_id=b8f272c6fe444c398be467df482538bd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:50.759252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd6397-6131-4887-85f0-da5de060764e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:50.790842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4d45b080-dd4a-46a5-bfcf-0050145fc51c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:50.796618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d45b080-dd4a-46a5-bfcf-0050145fc51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:50.797210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 858/1737] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:50 2022] PUT /identity/v3/projects/d641385c4e8143fc8137dff94e6ca89b/users/b8f272c6fe444c398be467df482538bd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:50.798603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db58d1-351f-4073-88c1-b36117863762 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:50.798851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db58d1-351f-4073-88c1-b36117863762 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:50.799119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db58d1-351f-4073-88c1-b36117863762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:50.863559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-61db58d1-351f-4073-88c1-b36117863762 None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:50.869011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-61db58d1-351f-4073-88c1-b36117863762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.056666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 880/1738] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:51.058504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.059106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.060382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.103608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:51.105711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.107423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:51.123225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 881/1739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:51.124268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.141733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 859/1740] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Aug 4 06:55:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:51.142856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db58d1-351f-4073-88c1-b36117863762 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.149858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-61db58d1-351f-4073-88c1-b36117863762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.151430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d584476-67dc-4668-b717-8a1ac66648b9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.157237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.158392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.158679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.159054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.159908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.163568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.206663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db58d1-351f-4073-88c1-b36117863762 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.219347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.220064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.220338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.220607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] PATH_INFO: `/v3/projects/89ce3d8ab1ab4753910de289fdb3a375` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.222761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ce3d8ab1ab4753910de289fdb3a375)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.226856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.238336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 882/1741] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:51 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:51.242448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.263612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f31c-3fcc-4c83-ae17-6c3c0e536d9f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.270830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.272775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.273875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.274399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.275327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.278777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bc20b-1192-421b-86c6-373a56f4bbb3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.330185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 883/1742] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:51.330546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.330846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.332580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.347728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ce3d8ab1ab4753910de289fdb3a375', 'request_id': 'req-d34ad52c-776c-4b74-9605-9258fbdf3074'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:51.364362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:51.369864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ce3d8ab1ab4753910de289fdb3a375', 'request_id': 'req-d34ad52c-776c-4b74-9605-9258fbdf3074'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:51.399134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ce3d8ab1ab4753910de289fdb3a375', 'request_id': 'req-d34ad52c-776c-4b74-9605-9258fbdf3074'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:51.421909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:51.425579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.443880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] The token cache is being invalidate because project 89ce3d8ab1ab4753910de289fdb3a375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:51.444192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:51.444954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:51.448189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 860/1743] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:51 2022] DELETE /identity/v3/projects/89ce3d8ab1ab4753910de289fdb3a375 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:51.449173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.453196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.587091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 884/1744] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:51.588371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.598427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.673767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad52c-776c-4b74-9605-9258fbdf3074 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.688367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.690406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.694645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.695270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.696326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:51.696791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.710059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.754181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 861/1745] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:51.755687 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.759942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.769694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3123e-9989-46ea-8aa8-205866f63318 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.784066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.784940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.790565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.790565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.796215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.797882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d281-0fc6-4569-b267-f6cee1d9a8f7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.814148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.815314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.815948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.816498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.817743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.819688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.831368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.836134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f723f-2d18-46c1-857f-4e982171303a service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.850061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 862/1746] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:51.851333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:51.856061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.880613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 885/1747] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:51.883406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.883894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.884074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.898166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451216-7520-4db1-8fc6-7f93f5bd2a14 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:51.913331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:51.914284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:51.914629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:51.914971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] PATH_INFO: `/v3/projects/d641385c4e8143fc8137dff94e6ca89b/users/b8f272c6fe444c398be467df482538bd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:51.918468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d641385c4e8143fc8137dff94e6ca89b, user_id=b8f272c6fe444c398be467df482538bd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:51.927526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:51.946262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:51.947989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:51.962512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 863/1748] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:51 2022] PUT /identity/v3/projects/d641385c4e8143fc8137dff94e6ca89b/users/b8f272c6fe444c398be467df482538bd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:51.963468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.105952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 886/1749] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:52.105952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.114399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:52.123677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753bd5-8045-47e3-b0e3-f1373e16c2d9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:52.134408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:52.135085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.135378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.135656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.136898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:52.139456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba128f5-220a-4ad1-9ee9-1df997d2c7ba admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:52.139631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:52.159600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:52.160245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.160552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.160874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.161908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:52.162183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:52.164717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06179d85-52f5-4511-9f3e-5a5349e29bae admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:52.192144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 887/1750] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:52 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:52.194067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.195869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 864/1751] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:52.197320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989a21-79ae-42ed-a439-0476eb1d7928 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.197594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989a21-79ae-42ed-a439-0476eb1d7928 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.197883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989a21-79ae-42ed-a439-0476eb1d7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.224849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:52.268188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-66989a21-79ae-42ed-a439-0476eb1d7928 None None] MFA Rules not processed for user `b8f272c6fe444c398be467df482538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:52.271030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-66989a21-79ae-42ed-a439-0476eb1d7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:52.414733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1d35-3c13-4440-a5b3-eb12ac1cfc46 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:52.434949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:52.440020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.440821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.441250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.442053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:52.461962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:52.473114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 865/1752] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:52.474914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.474914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.475234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.498474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 888/1753] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:52.508056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.534879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:52.535009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a5bf-5c9d-49bd-ab71-ed4d02ab9192 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:52.536513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:52.550510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:52.553030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.553030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.553030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.553685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:52.560222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:52.580281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 866/1754] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:52.581249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.626974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc5a41-f690-447f-9958-5d2c46e72db3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:52.641698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 889/1755] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:52 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:52.643037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.646900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:52.647856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:52.648323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:52.648748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:52.649682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:52.649824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:52.651864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:52.751350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 867/1756] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:52 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:52.752280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:52.907300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72b00-a1c0-4e03-ab9c-a73859308ba3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.001478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccfdcb-d445-4b82-8f6b-a5d569d77b37 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.014312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.015013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.015302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.015583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] PATH_INFO: `/v3/projects/46197319c47e48efa922228c7206759f/users/c617e753a8b4492f9a0be88f08ca82b2/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.025578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.026216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.026499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.026773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.052423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46197319c47e48efa922228c7206759f, user_id=c617e753a8b4492f9a0be88f08ca82b2, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.057871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.092719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 868/1757] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:52 2022] PUT /identity/v3/projects/46197319c47e48efa922228c7206759f/users/c617e753a8b4492f9a0be88f08ca82b2/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:53.095092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.189421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:53.190863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:53.202612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.218673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.261232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 890/1758] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:53.263683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.306511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef269-b44c-4612-8036-9774c36ca2f6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.323155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccc91-8ad3-4526-a267-ea5d212ab3cd service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.326252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.326902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.327187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.327462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.328160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:55:53.328461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.337865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.338875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.339453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.339966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.340972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.342177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43495de1-83d7-4b13-b934-c99957c4f945 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.343234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.356830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 891/1759] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:53.359427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.391103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3653aa-1066-4950-8a17-a9492ece8509 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.407657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.412022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.415156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.415469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.416183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.421565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.444251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 869/1760] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:55:53.445703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.445993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.446272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.512971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:53.514224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:53.521511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 892/1761] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:53 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:53.522263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.540216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 870/1762] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:53.541295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.554915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c77eb-86c0-497e-9a91-5c59632d3edd None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.560904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667793c-148c-40ce-b5ab-71f2a249afcb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.572840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.573641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.573931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.574208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.574937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.575118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.575905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.576624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.577291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.577712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.581806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.585842 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.588800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 893/1763] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:53.589639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.601045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd156f2-4e62-453f-9d44-1e537bdd6d42 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.607985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.608877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.609851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.610269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.611746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.613980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.638422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 894/1764] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:53.638422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.642542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:53.659583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 871/1765] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:53 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:53.660891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.727651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943e7fb-1ce8-4562-97d1-fcac08ad65b0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.741727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0206c-8ecb-4b60-9674-8374c224086d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.746920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.747702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.748084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.748465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] PATH_INFO: `/v3/projects/2020d1be7ce64792aa4ffbabd3534dbe/users/ff240b8671464250a39406d6021b271b/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.764756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2020d1be7ce64792aa4ffbabd3534dbe, user_id=ff240b8671464250a39406d6021b271b, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.767854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.783650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 872/1766] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:53 2022] PUT /identity/v3/projects/2020d1be7ce64792aa4ffbabd3534dbe/users/ff240b8671464250a39406d6021b271b/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:53.784711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.791930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.792728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.793091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.793325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.806925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.808517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.823144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 895/1767] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:53.823925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:53.846893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975b35-de3c-42f0-85dc-7a80b9c3eb76 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.915880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861e10-42b5-4243-9dad-0f9a69d6fcc9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:53.931266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.933205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.935084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.935625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] PATH_INFO: `/v3/users/c36d8827781c46acb981fd7fc9c1882c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.937761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36d8827781c46acb981fd7fc9c1882c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.944928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.965084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:53.965739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:53.966026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:53.966310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:53.968458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:53.984652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:53.996927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:54.003813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:54.024189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 896/1768] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:54.025311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.048869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea054e0-a043-4ceb-9a81-4360bc24bfdc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.059594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.060564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.060945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.061350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.062126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.064410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9709-5f2c-4ac1-b665-a8fdf88ea014 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.077648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36d8827781c46acb981fd7fc9c1882c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:54.079593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36d8827781c46acb981fd7fc9c1882c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:54.103654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36d8827781c46acb981fd7fc9c1882c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:54.106208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36d8827781c46acb981fd7fc9c1882c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:54.126495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 897/1769] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:54.136923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.137613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.138970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.143874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36d8827781c46acb981fd7fc9c1882c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:54.188291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:54.189844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.196279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 873/1770] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:53 2022] DELETE /identity/v3/users/c36d8827781c46acb981fd7fc9c1882c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:54.198706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.203003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.303158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 898/1771] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:54.303158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.304190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.318405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a13c3-409e-4dbd-b589-da8c379229a3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.323677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.324464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.324871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.326977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.328526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.330339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c89a1-52d3-4d2f-86cd-62f853a5302c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.345383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9a08-4005-4c55-b0dd-99916aa0dd10 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.356206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.356934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.357252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.357601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] PATH_INFO: `/v3/projects/d9b3192f9cb749a898b0944b6e738a29/users/cccc7a353d5d4318882663b99ca27fb1/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.366287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 899/1772] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:54.368007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.368433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.368819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.397213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b3192f9cb749a898b0944b6e738a29, user_id=cccc7a353d5d4318882663b99ca27fb1, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.403768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.408823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:54.410542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.433440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 874/1773] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:54 2022] PUT /identity/v3/projects/d9b3192f9cb749a898b0944b6e738a29/users/cccc7a353d5d4318882663b99ca27fb1/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:54.434597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.438602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.447987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 900/1774] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:54.449517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.467282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14a7c-1335-468c-9ad7-4e68adf62843 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.563347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510018-2f62-4ef0-a88f-5bfa25ffcd92 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.574440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.575783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.579715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.581131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.587122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.588102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.588710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.589186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.590029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.592111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a27dd-dc41-4278-9d9a-70026f7ea4ea admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.609662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 901/1775] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:54.609662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.609662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.609662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.616651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.618352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.637949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 875/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:54.639923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.663200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] MFA Rules not processed for user `cccc7a353d5d4318882663b99ca27fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:54.663407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1992f9-e485-45d1-8114-9d2b807d1654 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.664444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:54.674640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.675737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.676027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.676307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.717731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.719451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.754533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 876/1777] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:54.756872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.769954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:54.796665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 902/1778] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:54.800861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7485641-778c-4dd0-9fb0-f4554dc4fbb3 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.802758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.807429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.808235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.808414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.808693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] PATH_INFO: `/v3/projects/b6f845dc659645f086e8d09ff5b24a6b/users/6d612d9eb34243d3b745db6c9e68ff77/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.813020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:54.817409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21f68-e4c0-48e3-a504-e80c0d53fa68 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:54.823729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:54.824371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.824711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.824933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.826842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.829008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.837773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f845dc659645f086e8d09ff5b24a6b, user_id=6d612d9eb34243d3b745db6c9e68ff77, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:54.840970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60579dc9-3a90-4b5a-9c56-ee3e9f96c64d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:54.874915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 877/1779] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:54 2022] PUT /identity/v3/projects/b6f845dc659645f086e8d09ff5b24a6b/users/6d612d9eb34243d3b745db6c9e68ff77/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:54.885900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:54.886467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:54.886834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:54.899136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 903/1780] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:54.906264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:54.934757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] MFA Rules not processed for user `6d612d9eb34243d3b745db6c9e68ff77`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:54.935677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:55.049381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37106-184c-4bce-9a1e-b70dd6a15d2c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.079182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.081993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.082750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.086051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.088528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.095749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.098463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 878/1781] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:55:55.103558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.128739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664a68-ac43-48e2-b390-b347853afb9c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.144359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.146562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.147201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.147763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.152288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.152870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 904/1782] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:54 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:55.154763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.156732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.191764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc4b7e-4297-4b99-87ea-5395bd94ec48 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.204669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.205757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.209120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.209764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.210673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.228223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.252974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 879/1783] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:55 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:55:55.257685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.261136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 905/1784] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:55.271767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.294884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3f2a-3fb4-4cf6-a3e9-59b09403995f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.373601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f2f8-c184-4f3a-a478-7247e424cdb4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.378531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.379157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.379433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.379702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.380761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.382759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.417101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 880/1785] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:55 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:55.421864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.446039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0804f9-c244-4f47-abac-c1441fa73399 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.457472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.458689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.458996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.459268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.460130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.463317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.467196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.467964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.468247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.468519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] PATH_INFO: `/v3/projects/a9c279fee2c24125811fd0548cb8458e/users/e16d0b3fd58848a49b2d71befabf53fd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.494096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 881/1786] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:55.495031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.507386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c279fee2c24125811fd0548cb8458e, user_id=e16d0b3fd58848a49b2d71befabf53fd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.510372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.519117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65e9d-73af-490a-8c6e-698a6f2e80cd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.526011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.530179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.530438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.530653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] PATH_INFO: `/v3/projects/f992bab4c77044a69b002407f3692019/users/68764ef0b7f64f7abb7b8598a9c2b5e0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.534961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 906/1787] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:55 2022] PUT /identity/v3/projects/a9c279fee2c24125811fd0548cb8458e/users/e16d0b3fd58848a49b2d71befabf53fd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:55.539306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.574323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f992bab4c77044a69b002407f3692019, user_id=68764ef0b7f64f7abb7b8598a9c2b5e0, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.578316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117184ba-359c-4613-af4b-1c80702632aa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:55.604356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 882/1788] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:55 2022] PUT /identity/v3/projects/f992bab4c77044a69b002407f3692019/users/68764ef0b7f64f7abb7b8598a9c2b5e0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:55.612069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.612490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.616181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.634701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:55.657515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:55.717509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:55.718829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:55.760869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3452-57f1-4b9f-b1ba-9658a1e764f7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:55.959077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 883/1789] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:55:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:55.959989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:55.978838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:55.979943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:55.980484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:55.980885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:55.981901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:55.983665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.066973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 907/1790] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:55:56.071462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.082542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6ad9d-f36b-47c8-bc64-7e5374f45ec6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.086213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f64cc-4953-4fb9-9e4e-7e90043f278f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.089988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.090768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.091118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.091527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.092308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.093974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.096124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.096636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.097128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] PATH_INFO: `/v3/projects/a9c279fee2c24125811fd0548cb8458e/users/e16d0b3fd58848a49b2d71befabf53fd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.097931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.102732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c279fee2c24125811fd0548cb8458e, user_id=e16d0b3fd58848a49b2d71befabf53fd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.107433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcff9f1-29f2-433c-baca-b32b1671ea04 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.121638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 884/1791] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:56.124677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.136716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1976-615f-4369-a287-861061d740fe admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.155389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 908/1792] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:56 2022] PUT /identity/v3/projects/a9c279fee2c24125811fd0548cb8458e/users/e16d0b3fd58848a49b2d71befabf53fd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:56.167796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.168320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.168821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.209595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.210303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.210590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.210864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] PATH_INFO: `/v3/projects/f992bab4c77044a69b002407f3692019/users/68764ef0b7f64f7abb7b8598a9c2b5e0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.213354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f992bab4c77044a69b002407f3692019, user_id=68764ef0b7f64f7abb7b8598a9c2b5e0, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.216140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9559b6-03fc-4164-8940-782982b1f722 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.230527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 885/1793] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:56 2022] PUT /identity/v3/projects/f992bab4c77044a69b002407f3692019/users/68764ef0b7f64f7abb7b8598a9c2b5e0/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:56.245857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.246148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.246426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.256852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] MFA Rules not processed for user `e16d0b3fd58848a49b2d71befabf53fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:56.258433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:56.263272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:56.283754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] MFA Rules not processed for user `68764ef0b7f64f7abb7b8598a9c2b5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:56.285885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:56.367833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 886/1794] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:56.368761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.370040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:56.380486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 909/1795] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:55:56.381945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.383176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:56.521076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c658-fe3a-4592-962b-640a5fc4c8d4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.521945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:56.527421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3abba-f77a-48a7-a19d-d2410d9a25d6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.528523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.529787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.530386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.530670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.533316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.534245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.534849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.535312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.548152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.550602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.562577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 910/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:56.563679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.565672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:56.581470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afb846-9d44-4c11-855a-25e634be0744 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.587311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.588222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.588725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.589252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.604377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.606601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.620038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 911/1797] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:56.637870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:56.639900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:56.651243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 887/1798] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:55:56.776505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.790109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40d48-a340-4820-be4d-1c40343afa7d service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.809244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.819321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.820276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.820569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.833904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:56.851905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037665-fca8-4e9a-a292-7e14e56952a7 service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:56.869187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:56.869924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:56.870232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:56.870407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:56.905332 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:57.026231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:57.029508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732a271-b106-4437-9df4-e3d8fb9e9274 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:57.089801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 912/1799] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:57.097149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:57.097346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:57.097594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:57.101481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:57.102955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a5c5-5c8e-4ef1-9f44-c5eaf21b3a77 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:57.126728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 888/1800] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:57.128070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:57.128363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:57.128860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:57.135779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:57.137811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:57.221363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] MFA Rules not processed for user `c617e753a8b4492f9a0be88f08ca82b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:55:57.222685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:57.298314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 913/1801] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Aug 4 06:55:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:57.482894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 889/1802] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:55:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:55:57.484538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:57.486051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:57.495376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:57.500556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:57.532388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c866-fe74-4aee-89c7-b8152bec747a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:57.558575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:57.559739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:57.560677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:57.561776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:57.580871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:57.585359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:57.611171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 890/1803] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:55:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:55:57.714274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f0495-d87a-45b0-a937-5b9a8580eec5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:57.728627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:57.729398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:57.729692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:57.730324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:57.731320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:57.740658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:57.810465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 914/1804] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:55:57 2022] POST /identity/v3/projects => generated 401 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:57.814849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:57.838719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0f2b-72da-4f7d-a5cc-ac486b01798f service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:58.048098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:58.048763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:58.049068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:58.049408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:58.050104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:58.056652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:58.121619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:58.124923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 891/1805] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:55:57 2022] POST /identity/v3/users => generated 307 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:55:58.136432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbe11a-9b09-4785-b1ea-5239022b2422 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:58.142644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:58.143418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:58.143757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:58.144037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:58.145033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:58.146867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:58.149916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:58.207987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:58.222703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 915/1806] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:58.228395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d4922-a476-44f2-bd01-bba6b5508cd4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:58.245034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:58.245914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:58.247322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:58.247716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] PATH_INFO: `/v3/projects/bddae8de189647edbb973ea438ca96df/users/85aed4a813c047ddb2096a50190d75ef/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:58.299280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddae8de189647edbb973ea438ca96df, user_id=85aed4a813c047ddb2096a50190d75ef, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:58.340111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:58.352727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:55:58.386988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 892/1807] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:58 2022] PUT /identity/v3/projects/bddae8de189647edbb973ea438ca96df/users/85aed4a813c047ddb2096a50190d75ef/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:55:58.389944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:58.409286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99cc84-2079-41a8-bfa9-91e6eb8f203e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:58.674812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:58.675545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:58.675831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:58.676113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:58.677381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:58.698605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:58.764449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:58.772393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 916/1808] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:55:58.803467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546972ad-2a13-49a3-af98-fd22f4f4d78c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:58.824290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:58.828673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:58.830237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:58.831674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] PATH_INFO: `/v3/projects/bddae8de189647edbb973ea438ca96df/users/85aed4a813c047ddb2096a50190d75ef/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:58.843970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddae8de189647edbb973ea438ca96df, user_id=85aed4a813c047ddb2096a50190d75ef, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:58.855913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:58.885809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 893/1809] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:55:58 2022] PUT /identity/v3/projects/bddae8de189647edbb973ea438ca96df/users/85aed4a813c047ddb2096a50190d75ef/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:59.048653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:59.050938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:59.112816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c1c2-6d44-4e39-8ad8-c7dd73f195d8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:59.343110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:59.345224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:59.345742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:59.346594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] PATH_INFO: `/v3/projects/80f6573dc16745418853f33fb100922f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:59.351639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f6573dc16745418853f33fb100922f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:59.354322 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:55:59.504698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f6573dc16745418853f33fb100922f', 'request_id': 'req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:59.533444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f6573dc16745418853f33fb100922f', 'request_id': 'req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:59.557549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f6573dc16745418853f33fb100922f', 'request_id': 'req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:59.595168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] The token cache is being invalidate because project 80f6573dc16745418853f33fb100922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:55:59.595878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:59.597425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:55:59.605430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 917/1810] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:55:59 2022] DELETE /identity/v3/projects/80f6573dc16745418853f33fb100922f => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:55:59.609878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:55:59.612787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:55:59.651790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29c25-82c5-484c-ae04-aa2c7e64dc83 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:55:59.837967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:55:59.839403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:55:59.840199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:55:59.842278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] PATH_INFO: `/v3/users/b8f272c6fe444c398be467df482538bd` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:55:59.845704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f272c6fe444c398be467df482538bd)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:55:59.852705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:00.006526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f272c6fe444c398be467df482538bd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:00.007894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f272c6fe444c398be467df482538bd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:00.043113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f272c6fe444c398be467df482538bd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:00.044691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f272c6fe444c398be467df482538bd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:00.096890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-12721480-35ea-4793-9dbc-4cdfd9fdb494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f272c6fe444c398be467df482538bd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:00.137718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 894/1811] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:55:59 2022] DELETE /identity/v3/users/b8f272c6fe444c398be467df482538bd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:01.333667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:01.337800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:01.370284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d3f2-0e17-4d84-993d-4f965a2c5b4b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:01.413153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:01.482055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdde24-0173-4866-bbb3-33f9d70957ae None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:01.482519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdde24-0173-4866-bbb3-33f9d70957ae None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:01.487785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdde24-0173-4866-bbb3-33f9d70957ae None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:01.491275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 895/1812] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:56:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:56:01.525853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:01.527903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:01.528349 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:01.530150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] PATH_INFO: `/v3/users/6d612d9eb34243d3b745db6c9e68ff77` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:01.539928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d612d9eb34243d3b745db6c9e68ff77)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:01.540703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:01.543542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:01.544280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:01.554024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:01.626918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:01.629991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:01.662169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d612d9eb34243d3b745db6c9e68ff77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:01.664754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d612d9eb34243d3b745db6c9e68ff77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:01.666067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d612d9eb34243d3b745db6c9e68ff77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:01.690021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d612d9eb34243d3b745db6c9e68ff77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:01.728969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-438b116b-d77e-4451-ab15-0f82f554429c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d612d9eb34243d3b745db6c9e68ff77'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:01.750315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:01.751409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 918/1813] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:01 2022] DELETE /identity/v3/users/6d612d9eb34243d3b745db6c9e68ff77 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:01.756240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314518e-c19c-443b-a117-14856a8f45c1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:01.756599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314518e-c19c-443b-a117-14856a8f45c1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:01.757007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314518e-c19c-443b-a117-14856a8f45c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:01.800472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0314518e-c19c-443b-a117-14856a8f45c1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:01.802390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0314518e-c19c-443b-a117-14856a8f45c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:01.803434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 896/1814] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:56:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:01.977639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 919/1815] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:01.994659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:01.996453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.073700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.073992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.074273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.119920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21477b88-7fda-44c7-b6e1-7b99ac8d0de1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.134340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] MFA Rules not processed for user `85aed4a813c047ddb2096a50190d75ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:02.138348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.218104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:02.232740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.233997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.236035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.237553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.287491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:02.288937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:02.331550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 897/1816] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:02.335636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:02.336269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 920/1817] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:02.338956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.389917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:02.391451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.416181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e992ad-9ba9-467f-9d3d-7c7ec65e2627 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.431096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.431928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.432221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.432668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] PATH_INFO: `/v3/projects/d641385c4e8143fc8137dff94e6ca89b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.434490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d641385c4e8143fc8137dff94e6ca89b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:02.436763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:02.491773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7de9ae-06f3-443b-9a0b-418a2944df7f service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.503487 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.504468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.505068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.505756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.526019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:02.528430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd641385c4e8143fc8137dff94e6ca89b', 'request_id': 'req-711953e8-ea10-4492-ba99-a4f580778756'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:02.529458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa759-e5f6-4541-acbf-b62525fb9144 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:02.535742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd641385c4e8143fc8137dff94e6ca89b', 'request_id': 'req-711953e8-ea10-4492-ba99-a4f580778756'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:02.548002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd641385c4e8143fc8137dff94e6ca89b', 'request_id': 'req-711953e8-ea10-4492-ba99-a4f580778756'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:02.553860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 898/1818] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:02.577312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] The token cache is being invalidate because project d641385c4e8143fc8137dff94e6ca89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:02.577700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:02.580266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-711953e8-ea10-4492-ba99-a4f580778756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:02.587493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.587644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 921/1819] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:02 2022] DELETE /identity/v3/projects/d641385c4e8143fc8137dff94e6ca89b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:02.587980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.588285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.614121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:02.615570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.650092 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:02.703977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 899/1820] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:02.704117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.704117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.704117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.726834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:02.728867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.740708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 922/1821] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:02.742179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:02.756138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18f1c-94d0-49c5-9f6a-f09c3515ca0d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.762647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.763273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.763558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.763831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.764544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:02.764843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:02.766494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b727e1-4c1d-40dc-afc4-f58fef45072e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:02.780239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 900/1822] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:02.784226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:02.796280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708adf77-132e-4fc7-840d-c05fc8dfe245 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.801299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.802594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.802916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.803261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.804033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:02.806082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2ccb8-721d-4090-b757-dedcdbf3a956 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:02.835670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb59-1bda-42e2-8c42-5f74fd7405a2 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.836511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb59-1bda-42e2-8c42-5f74fd7405a2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.836815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb59-1bda-42e2-8c42-5f74fd7405a2 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.838485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 901/1823] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:56:02.845228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 923/1824] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:02.847881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abb59-1bda-42e2-8c42-5f74fd7405a2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:02.859332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.859625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:02.859906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:02.886505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:02.888882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:02.972182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 924/1825] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:02.991703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abb59-1bda-42e2-8c42-5f74fd7405a2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:02.998807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:02.999454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:02.999834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.000212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.001020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.003509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b1adc-13fc-4ffc-b3c1-29dfba917e5a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.049125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.051288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.080861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b0b-f757-43bd-a391-ea2eb2abd1fe None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.094047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 902/1826] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:02 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:03.096004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.098606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.099139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.099676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.103502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.103903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.104190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.128393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.136251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.146524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] MFA Rules not processed for user `ff240b8671464250a39406d6021b271b`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:03.147848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.189568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 925/1827] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:03.193844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.218200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:03.228377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10928e1-685a-480d-90c4-6232709f86a0 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.241125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.241821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.242174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.242543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.243570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.245366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.263107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 926/1828] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:03.266412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.281747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16324041-991c-42bb-92f3-613f51c02c96 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.285011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 903/1829] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:03.287933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.288570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.288857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.289185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.290194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.305145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.317633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.321028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.330739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 927/1830] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:03.335153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.350784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb86ee-dbe9-4c6e-a022-f5a1dba1264e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.358475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.359812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba6cda-7903-4f6d-a2ac-55bbb1bc79b5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.360579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.361052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.361685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] PATH_INFO: `/v3/projects/646e94fdb0cc42129716e388516e7430/users/95b9d11506d54e0e9117d1f216e373b2/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.374411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.375139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.375489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.376118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.376871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.379178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.404492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646e94fdb0cc42129716e388516e7430, user_id=95b9d11506d54e0e9117d1f216e373b2, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.414470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7108d6-8ac6-4546-a73b-f46691c37bc9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.432389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 904/1831] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:03.434142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.450703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 928/1832] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:03 2022] PUT /identity/v3/projects/646e94fdb0cc42129716e388516e7430/users/95b9d11506d54e0e9117d1f216e373b2/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:03.452227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.452517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.452857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.482856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:03.488753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] MFA Rules not processed for user `95b9d11506d54e0e9117d1f216e373b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:03.490220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.534110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e9bc-c743-40de-b742-61cdfbee6b51 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.573195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 929/1833] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:03.581775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.612389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.612389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.612389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.612389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.612848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.613261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.665764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 905/1834] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:03.665764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.667158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.681398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf93aa5-5a05-4f72-9328-8dec21dada37 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.686898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.687662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.688038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.688430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] PATH_INFO: `/v3/projects/b6f845dc659645f086e8d09ff5b24a6b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.689973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f845dc659645f086e8d09ff5b24a6b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.693065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.696369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c67af5-9764-4015-a613-ffcf4e9962fa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.705152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.705874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.706155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.706431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.707274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.710112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.744459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 930/1835] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:03.744459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.756525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f845dc659645f086e8d09ff5b24a6b', 'request_id': 'req-7e573814-662a-435e-afb0-3c76dc6a1d76'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.764116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f845dc659645f086e8d09ff5b24a6b', 'request_id': 'req-7e573814-662a-435e-afb0-3c76dc6a1d76'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.773296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f845dc659645f086e8d09ff5b24a6b', 'request_id': 'req-7e573814-662a-435e-afb0-3c76dc6a1d76'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.785475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:03.790984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] The token cache is being invalidate because project b6f845dc659645f086e8d09ff5b24a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:03.791377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.792147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.794335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 906/1836] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:03 2022] DELETE /identity/v3/projects/b6f845dc659645f086e8d09ff5b24a6b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:03.795038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.796429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.830968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb712c2-3199-4b9e-97d6-83683087eeb0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.836108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.836813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.837229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.837568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.838361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.840025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c0828-c329-45e4-a91b-ae8b61c142b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.852393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 931/1837] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:03.852785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:03.854013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.854139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.854472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.855774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 932/1838] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:56:03.856441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.858268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.879955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1006a6-1a39-4bb7-bf4f-29bd05ef53db None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.880204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573814-662a-435e-afb0-3c76dc6a1d76 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.884804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.885384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.885565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.885938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.886073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.886282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.886378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.886557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] PATH_INFO: `/v3/users/68764ef0b7f64f7abb7b8598a9c2b5e0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.887094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.887900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68764ef0b7f64f7abb7b8598a9c2b5e0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.889192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.890076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.913580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 907/1839] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:03.917726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.919863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:03.933854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326b888-cdca-44a6-bae0-ca095d144dce admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:03.938716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:03.939477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.939825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.940166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] PATH_INFO: `/v3/projects/b0f040e35ee64d149e01f61b06f346e2/users/a3cbce1eebf24c4abb303b9aff99b568/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.947139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68764ef0b7f64f7abb7b8598a9c2b5e0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.947829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68764ef0b7f64f7abb7b8598a9c2b5e0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.948459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68764ef0b7f64f7abb7b8598a9c2b5e0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.956323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68764ef0b7f64f7abb7b8598a9c2b5e0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.962281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f040e35ee64d149e01f61b06f346e2, user_id=a3cbce1eebf24c4abb303b9aff99b568, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:03.965062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:03.971333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cfa183eb-bead-4f93-ba9e-e1d21058d470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68764ef0b7f64f7abb7b8598a9c2b5e0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:03.986929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 908/1841] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:03 2022] PUT /identity/v3/projects/b0f040e35ee64d149e01f61b06f346e2/users/a3cbce1eebf24c4abb303b9aff99b568/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:03.988387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:03.990255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 933/1841] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:03 2022] DELETE /identity/v3/users/68764ef0b7f64f7abb7b8598a9c2b5e0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:03.992817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:03.993204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:03.993540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:03.994472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:04.027308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:04.030413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:04.084168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4af2e-6806-4103-8b01-c8bfb9769108 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.114908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 934/1842] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:56:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:04.115700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.117151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:04.174095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.174977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.175331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.176121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.177409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.178747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:04.179694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.191533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 909/1843] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:04.193463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.196585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:04.211897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044c7a-aa3c-4879-90c3-94d4c2256b41 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.217286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.218175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.218299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421e77-6e3d-40b6-b4dc-4fbae18911ae None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.218629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.218943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.223918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.224630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.224968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.225345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.226150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.227864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.230679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.232413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.240739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 935/1844] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:04.241783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.249456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 910/1845] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:04.250347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.261246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8977ff-ddca-4ce8-a008-0f98164e64b1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.262059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7796a-789a-4641-b1b9-88aba774d720 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.267398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.268707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.269019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.269350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.269468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.270224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.270688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.270810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.271426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] PATH_INFO: `/v3/projects/b0f040e35ee64d149e01f61b06f346e2/users/a3cbce1eebf24c4abb303b9aff99b568/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.273423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.274511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f040e35ee64d149e01f61b06f346e2, user_id=a3cbce1eebf24c4abb303b9aff99b568, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.277526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f20c-8252-4ffe-a4c0-3ff81ad89fdc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.293631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 936/1846] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:04.297315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.299578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 911/1847] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:04 2022] PUT /identity/v3/projects/b0f040e35ee64d149e01f61b06f346e2/users/a3cbce1eebf24c4abb303b9aff99b568/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:04.308794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70450b15-b89d-4aec-ad1e-78b3c2ef7019 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.376787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.377880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.378223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.378550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] PATH_INFO: `/v3/projects/0bcf5337abf84f47a2df2064622f468a/users/c7638da204fb4270b9aadc3f8ab18713/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.396220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf5337abf84f47a2df2064622f468a, user_id=c7638da204fb4270b9aadc3f8ab18713, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.399437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:04.428849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 937/1848] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:04 2022] PUT /identity/v3/projects/0bcf5337abf84f47a2df2064622f468a/users/c7638da204fb4270b9aadc3f8ab18713/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:04.439984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.440191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.441180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.532793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] MFA Rules not processed for user `c7638da204fb4270b9aadc3f8ab18713`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:04.534726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:04.562526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:04.787133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 912/1849] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:04.788624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:04.898743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a56230-f392-4b97-b9e4-3462ac2a2869 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:04.925516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:04.926178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:04.926461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:04.926803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:04.927499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:04.931348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a71c-9706-4304-8795-e4cfa70e4243 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.013364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 938/1850] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:04 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:05.017571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.039609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812d30c-45bf-4158-8afc-ec837f8d9675 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.220686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f32b-af86-4121-ba97-233b0901fc59 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.221344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f32b-af86-4121-ba97-233b0901fc59 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.221802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f32b-af86-4121-ba97-233b0901fc59 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.224867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 939/1851] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:56:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:56:05.287403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.288510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.289104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.289648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.290594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.293658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.335472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.336252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.336252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.343558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 913/1852] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:05 2022] POST /identity/v3/users => generated 296 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:05.353229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.384497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514446-64cd-4832-ba80-a81a982ad6fa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.387290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] MFA Rules not processed for user `11759ed684c74cadada92aef1f6d0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:05.391086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:05.396445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.400330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.400330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.401759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.402797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.409389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.458351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 914/1853] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:05.461147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.474821 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:05.491558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:05.498023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e59f2-bff8-4638-ae92-e445e6c52368 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.516849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.517556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.517838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.518126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] PATH_INFO: `/v3/users/c617e753a8b4492f9a0be88f08ca82b2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.519338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c617e753a8b4492f9a0be88f08ca82b2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.521526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.617975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c617e753a8b4492f9a0be88f08ca82b2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:05.619123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 940/1854] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:56:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:05.620414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.621470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c617e753a8b4492f9a0be88f08ca82b2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:05.646622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c617e753a8b4492f9a0be88f08ca82b2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:05.648220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47868da1-3b20-449e-b246-5a841c67b6cc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.649114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c617e753a8b4492f9a0be88f08ca82b2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:05.659458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.661920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.662308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.662677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] PATH_INFO: `/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1/users/f076b49c8da5468ba6801f8f375ebc1c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.709365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c617e753a8b4492f9a0be88f08ca82b2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:05.728765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9322e4322b6a4e93a407b6adcf4cebc1, user_id=f076b49c8da5468ba6801f8f375ebc1c, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.736836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.756249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 915/1855] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:05 2022] DELETE /identity/v3/users/c617e753a8b4492f9a0be88f08ca82b2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:05.758454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.765728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:05.787538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 941/1856] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:05 2022] PUT /identity/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1/users/f076b49c8da5468ba6801f8f375ebc1c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:05.790045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.792873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:05.795803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:05.885810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48017-09bf-4ca4-9480-6153a2d53fb7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.891370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.891988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.892395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.892739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.893654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.896333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.914465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 942/1857] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:05.915666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:05.934224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747088-a434-4cf7-8604-c056f60d029e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:05.943146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:05.944000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:05.944252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:05.944645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] PATH_INFO: `/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1/users/f076b49c8da5468ba6801f8f375ebc1c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:05.954221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9322e4322b6a4e93a407b6adcf4cebc1, user_id=f076b49c8da5468ba6801f8f375ebc1c, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:05.969063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e203a-2cee-4ae7-9523-e216da0669db admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:05.996579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7d1c-2e1a-4e12-8f0e-5f13f0881ce7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:06.009002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 943/1858] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:05 2022] PUT /identity/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1/users/f076b49c8da5468ba6801f8f375ebc1c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:06.021770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.022329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.022766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.069329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] MFA Rules not processed for user `f076b49c8da5468ba6801f8f375ebc1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:06.071066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.186237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:06.187310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.187757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.188201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] PATH_INFO: `/v3/projects/f992bab4c77044a69b002407f3692019` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.191157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f992bab4c77044a69b002407f3692019)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:06.194014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:06.283711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 944/1859] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:06.284707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:06.286703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.315746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:06.369217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f992bab4c77044a69b002407f3692019', 'request_id': 'req-3a4dffd9-94ba-4dd4-b91e-876124ed2841'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:06.390322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f992bab4c77044a69b002407f3692019', 'request_id': 'req-3a4dffd9-94ba-4dd4-b91e-876124ed2841'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:06.414855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f992bab4c77044a69b002407f3692019', 'request_id': 'req-3a4dffd9-94ba-4dd4-b91e-876124ed2841'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:06.435779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] The token cache is being invalidate because project f992bab4c77044a69b002407f3692019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:06.436391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:06.438834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:06.444620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 916/1860] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:05 2022] DELETE /identity/v3/projects/f992bab4c77044a69b002407f3692019 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:06.447346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:06.451364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.509654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f341fc8-8abb-48ab-b50b-d917b5bcae60 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:06.562166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:06.599238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dffd9-94ba-4dd4-b91e-876124ed2841 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:06.606373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:06.607826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.608120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.608397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.630449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.662757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:06.663406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.663833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.664114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.666320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.687967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:06.690238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f4aed-1d72-4a9a-8013-1cb7f6ecdb2b service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:06.713200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 945/1861] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:06.716315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.717115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.717636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.748495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:06.750162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:06.872803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:06.874535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bee99c-ed15-4148-9ae0-facbb1f7733c service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:06.901982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 917/1862] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:06.931553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:06.931956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:06.932289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:06.933366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 946/1863] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:06.994348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:06.995643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:07.038118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 918/1864] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:07.044081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.054343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.060096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034cf4a-20fb-47b5-bdef-f64791788152 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.078734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:07.079455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b859f-e538-40f4-9c24-070dca9812f8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.080714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:07.082473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:07.082473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:07.083976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:07.084543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:07.087435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:07.089829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:07.090776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:07.091074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:07.091328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:07.100381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:07.123101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 947/1865] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:07.127497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.151162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5759-36cc-408e-95f6-ddb0439e4f47 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.158292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:07.158947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:07.159248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:07.159937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:07.161751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:07.170683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:07.231188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 948/1866] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:07 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:07.232603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.257474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:07.325944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:07.327389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:07.349792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 919/1867] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:07.579952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.582346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:07.604546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41d03-a96f-4d33-9740-883c89879818 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.607560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bdb0d-8469-40a5-b13e-c9c335369e3e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.612398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:07.613321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:07.613755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:07.614703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] PATH_INFO: `/v3/projects/46197319c47e48efa922228c7206759f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:07.616331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46197319c47e48efa922228c7206759f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:07.618845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:07.638016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:07.638889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:07.640648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:07.641167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:07.642009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:07.647507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:07.743989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 949/1868] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:07 2022] POST /identity/v3/users => generated 289 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:07.749974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.758745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46197319c47e48efa922228c7206759f', 'request_id': 'req-4c958de0-6a76-4be6-9222-8502e1b94d52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:07.776177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343111b-9423-4537-afe7-e7be70ac7c6b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:07.786378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46197319c47e48efa922228c7206759f', 'request_id': 'req-4c958de0-6a76-4be6-9222-8502e1b94d52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:07.818696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46197319c47e48efa922228c7206759f', 'request_id': 'req-4c958de0-6a76-4be6-9222-8502e1b94d52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:07.867152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] The token cache is being invalidate because project 46197319c47e48efa922228c7206759f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:07.870046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:07.872357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:07.883135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 920/1869] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:07 2022] DELETE /identity/v3/projects/46197319c47e48efa922228c7206759f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:07.889695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:07.894229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:07.918104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:08.020104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:08.021821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.022051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.023517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.024178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:08.034601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:08.075857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 950/1870] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:08.082422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:08.089638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:08.120969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6a13-946e-4e30-af91-30474fa30a63 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:08.137087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:08.138121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.138773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.139394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.144125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:08.147879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:08.192298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 951/1871] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:08.198957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:08.223219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653dba-2d54-49cb-9ddf-e8818fdbafab admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:08.237222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:08.238847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.239658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.240408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] PATH_INFO: `/v3/projects/16e4a2390c6944b0a5a664690a74d7d4/users/c70142c20c0648d3896002e2f0ed5fca/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.266081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e4a2390c6944b0a5a664690a74d7d4, user_id=c70142c20c0648d3896002e2f0ed5fca, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:08.268272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958de0-6a76-4be6-9222-8502e1b94d52 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:08.270104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447b91-f7db-4d6c-9a4e-9e564cc5a427 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:08.290790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 952/1872] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:08 2022] PUT /identity/v3/projects/16e4a2390c6944b0a5a664690a74d7d4/users/c70142c20c0648d3896002e2f0ed5fca/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:08.303347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.304388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.304889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.308534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:08.309240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.309528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.309809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] PATH_INFO: `/v3/users/85aed4a813c047ddb2096a50190d75ef` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.318971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85aed4a813c047ddb2096a50190d75ef)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:08.336101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:08.363290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] MFA Rules not processed for user `c70142c20c0648d3896002e2f0ed5fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:08.365793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:08.547874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:08.569828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85aed4a813c047ddb2096a50190d75ef'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:08.578112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85aed4a813c047ddb2096a50190d75ef'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:08.612316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 953/1873] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:08.617981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:08.631115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85aed4a813c047ddb2096a50190d75ef'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:08.631976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85aed4a813c047ddb2096a50190d75ef'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:08.681518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85aed4a813c047ddb2096a50190d75ef'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:08.728116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 921/1874] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:07 2022] DELETE /identity/v3/users/85aed4a813c047ddb2096a50190d75ef => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:08.767221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0031de-34ab-4f68-9b29-d77c8aab9807 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:08.867830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:08.892800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:08.896848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:08.897630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:08.902663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:08.910505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc009e-4473-47ac-ad2b-3f019e3b5008 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:08.991467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 954/1875] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:08 2022] POST /identity/v3/projects => generated 377 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:08.996329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:08.998725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:09.022207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d619-6018-433b-88eb-1369671c3dcd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.145521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.145884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.146158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.201902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.204782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.204782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.204782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.204782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.212839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.224292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] MFA Rules not processed for user `a3cbce1eebf24c4abb303b9aff99b568`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:09.225819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:09.262992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 922/1876] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:08 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:09.268033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:09.294007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df018-b163-4e0b-918b-f66a3592b5f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.306158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.306906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.307988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.308320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.309209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.314432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.346968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 923/1877] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:09.348765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:09.362416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:09.370735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 955/1878] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:09.372317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3f134-b27e-49e6-a287-7c03181f2ca4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.387469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.388245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.388585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.388914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] PATH_INFO: `/v3/projects/52891bafbc014ac18bb4da0c546629d6/users/41a0d7a0ce6f4233ab95751da3d81f8f/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.402077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:09.404560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:09.416824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:09.430629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52891bafbc014ac18bb4da0c546629d6, user_id=41a0d7a0ce6f4233ab95751da3d81f8f, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.433552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.472166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 924/1879] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:09 2022] PUT /identity/v3/projects/52891bafbc014ac18bb4da0c546629d6/users/41a0d7a0ce6f4233ab95751da3d81f8f/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:09.474709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:09.585690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4cd3a-2620-40ba-a20c-e55c6e8a75c0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.706230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11d07-d9cf-43ce-a5e2-4e9c1e3d741f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.732617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.734320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.734828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.735321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.736953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.737891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.738182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.738520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.739855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:09.739974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.753819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.793195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 925/1880] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:09.794238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:09.836234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f905e-2c34-4143-b3c0-2744d6cf017a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:09.853293 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:09.854055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.854341 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.854676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] PATH_INFO: `/v3/projects/52891bafbc014ac18bb4da0c546629d6/users/41a0d7a0ce6f4233ab95751da3d81f8f/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.859022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52891bafbc014ac18bb4da0c546629d6, user_id=41a0d7a0ce6f4233ab95751da3d81f8f, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.862091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea563fc-6718-4fcb-a172-f740b1881372 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.904166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:09.913492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:09.931793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 926/1881] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:09 2022] PUT /identity/v3/projects/52891bafbc014ac18bb4da0c546629d6/users/41a0d7a0ce6f4233ab95751da3d81f8f/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:09.933488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:09.933779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:09.934112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:09.956414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 956/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:10.003845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] MFA Rules not processed for user `41a0d7a0ce6f4233ab95751da3d81f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:10.007685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:10.189038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 927/1883] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:10.522464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:10.533893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2269-1ec9-40a4-ae58-758c24a748d9 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:10.741727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:10.744441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:10.748358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:10.749080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:10.749473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:10.749741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:10.758616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:10.853770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:10.939032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:10.956014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:10.958516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce97075-ecc8-43dc-b15e-d989b047c7a8 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:10.988592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 957/1884] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:11.001572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ccf8-dc8a-40d4-9b80-0dea6d45c74d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.014291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.015225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.016015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.017353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] PATH_INFO: `/v3/projects/bddae8de189647edbb973ea438ca96df` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.021579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddae8de189647edbb973ea438ca96df)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.024881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.115238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddae8de189647edbb973ea438ca96df', 'request_id': 'req-460afe39-0df5-4553-b516-97a7a406d3f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:11.125280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddae8de189647edbb973ea438ca96df', 'request_id': 'req-460afe39-0df5-4553-b516-97a7a406d3f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:11.136932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddae8de189647edbb973ea438ca96df', 'request_id': 'req-460afe39-0df5-4553-b516-97a7a406d3f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:11.153986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] The token cache is being invalidate because project bddae8de189647edbb973ea438ca96df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:11.154460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:11.155398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-460afe39-0df5-4553-b516-97a7a406d3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:11.158248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 928/1885] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:10 2022] DELETE /identity/v3/projects/bddae8de189647edbb973ea438ca96df => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:11.163340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.163611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.163886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.189777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:11.192698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:11.266448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 958/1886] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:11.274928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.275217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.275500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.295931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:11.297196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:11.313193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 929/1887] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:11.318806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.328211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724407b-562e-495b-b2d6-54cc9aea8480 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.334014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.334586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.334871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.335145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.335840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:11.336173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.337811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.350911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 959/1888] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:11.355118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.366941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d617c1-aa11-452e-8195-4bc8be18dc56 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.371683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.372830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.373370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.373997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.374970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.377054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.429010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 930/1889] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:11.429142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.444492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bd5c7-ee94-42c5-b568-027d6e2e105e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.540812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.542254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.542900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.544545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.545730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.549780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.574424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 960/1890] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:11.579019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.592025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115141-fe2f-4c54-afd4-4417b1f048a2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.598587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.599307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.599673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.600022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.600828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.602688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.613853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 931/1891] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:11.617780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.627926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f1c9-2d42-46bd-9035-713b33fa067f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.632892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.633535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.633818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.634091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.634778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.636358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133033c3-4253-4b8d-aa48-a3c818dc9efa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.647099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 961/1892] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:11.651239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.662241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568524-f819-4d1b-8b52-8cc6a65d1f7d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.667848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.668508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.668790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.669101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] PATH_INFO: `/v3/projects/37c8aaf387314c69927162327e0b9c2d/users/428c7671c79c48f2b29f743b6e9ae6c3/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.686142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c8aaf387314c69927162327e0b9c2d, user_id=428c7671c79c48f2b29f743b6e9ae6c3, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.688825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.702333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 932/1893] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:11 2022] PUT /identity/v3/projects/37c8aaf387314c69927162327e0b9c2d/users/428c7671c79c48f2b29f743b6e9ae6c3/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:11.714033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.714324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.714600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.742707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] MFA Rules not processed for user `428c7671c79c48f2b29f743b6e9ae6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:11.743913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:11.767911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:11.809443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 962/1894] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:11.814543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.882497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af679-c108-40d8-9b2b-16673f64dce1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.887179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:11.887802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:11.888077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:11.888356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:11.889152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:11.891067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:11.911820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:11.920896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 933/1895] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:11.924826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.936961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62887-29b7-450d-83fd-c4098431d758 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:11.992482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:11.994210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.007529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.008241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.008563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.008845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.009587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.011533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.036059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 963/1896] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:11 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:12.040578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.052303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69b8a-f04e-4392-b5ff-e69b91e9de70 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.058752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.058752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.059051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.059279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.059982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.061623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.073633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 964/1897] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:12.074128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055332a-f1ef-43b5-bd04-30a667566e68 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.077911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.078554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.078829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.079097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.080971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.082021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.093577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b5782-b652-4672-864c-f555dc7fa345 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.101027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.101983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.102327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.102681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] PATH_INFO: `/v3/projects/ec92b58103da43bb9d619e8764420f5b/users/1ed722c51acf43a2a076b4b9755663ff/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.122849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec92b58103da43bb9d619e8764420f5b, user_id=1ed722c51acf43a2a076b4b9755663ff, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.125723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.151277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 965/1898] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:12 2022] PUT /identity/v3/projects/ec92b58103da43bb9d619e8764420f5b/users/1ed722c51acf43a2a076b4b9755663ff/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:12.158146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.178886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.180779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.197456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 934/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:12.246989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04f18-def3-4bfc-890a-2db2e83ccc5d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.261858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.262552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.262840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.263118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.263822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.265465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.287466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 966/1900] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:12.292204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.307449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f577-b840-45e0-8707-7c2d73aaeee5 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.312045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.312718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.313010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.313334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] PATH_INFO: `/v3/projects/ec92b58103da43bb9d619e8764420f5b/users/1ed722c51acf43a2a076b4b9755663ff/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.315391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec92b58103da43bb9d619e8764420f5b, user_id=1ed722c51acf43a2a076b4b9755663ff, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.318573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1eaf9-32be-42af-ad5f-01dbd0869b46 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.346153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 935/1901] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:12 2022] PUT /identity/v3/projects/ec92b58103da43bb9d619e8764420f5b/users/1ed722c51acf43a2a076b4b9755663ff/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:12.349880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.352797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.357288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.357666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.358079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.372775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ddb86-80dd-4fd6-b838-a06cda3228c8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.391026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:12.391214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] MFA Rules not processed for user `1ed722c51acf43a2a076b4b9755663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:12.392395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.496627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.497388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.497680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.498026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] PATH_INFO: `/v3/users/95b9d11506d54e0e9117d1f216e373b2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.499395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b9d11506d54e0e9117d1f216e373b2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.501333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.528094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 936/1902] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:12.542391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.544186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.573304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:12.575049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b9d11506d54e0e9117d1f216e373b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:12.575975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b9d11506d54e0e9117d1f216e373b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:12.576796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b9d11506d54e0e9117d1f216e373b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:12.585765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b9d11506d54e0e9117d1f216e373b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:12.604585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0f1e07b3-4caf-4c2e-97a1-4301e9ac649f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b9d11506d54e0e9117d1f216e373b2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:12.624056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 967/1903] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:12 2022] DELETE /identity/v3/users/95b9d11506d54e0e9117d1f216e373b2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:12.628700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.628700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.629095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.648070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75a5af-689c-4c43-a94c-39945164a55c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.671842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:12.674996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.761540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.762135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.762384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.762644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.766354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.800004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 968/1904] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:12.815485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:12.818003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:12.871113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:12.883729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.885573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.894310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501feb-a9ae-493d-9306-3e5855099ddd None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:12.895625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 937/1905] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:12.898256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:12.898882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:12.899165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:12.899471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:12.909071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:12.910716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:12.921420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 969/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:13.218711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:13.220458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:13.237995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091059a-8736-4bd3-86dd-676aa59b7ab6 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:13.243223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:13.243859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.244135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.244410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] PATH_INFO: `/v3/projects/646e94fdb0cc42129716e388516e7430` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.245617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] RBAC: Authorizing `identity:delete_project(project_id=646e94fdb0cc42129716e388516e7430)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:13.251036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:13.311026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646e94fdb0cc42129716e388516e7430', 'request_id': 'req-afb55e4c-f960-402c-9e4b-d3fb291084af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.319244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646e94fdb0cc42129716e388516e7430', 'request_id': 'req-afb55e4c-f960-402c-9e4b-d3fb291084af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.326980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646e94fdb0cc42129716e388516e7430', 'request_id': 'req-afb55e4c-f960-402c-9e4b-d3fb291084af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.344695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] The token cache is being invalidate because project 646e94fdb0cc42129716e388516e7430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:13.345041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.345773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.349156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 938/1907] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:13 2022] DELETE /identity/v3/projects/646e94fdb0cc42129716e388516e7430 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:13.352369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:13.360104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:13.361646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:13.364742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31149707-5cc4-47cf-b709-5d8bb0ecab5c service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:13.372501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:13.427762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:13.428328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.428609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.428881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] PATH_INFO: `/v3/users/c7638da204fb4270b9aadc3f8ab18713` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.430086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7638da204fb4270b9aadc3f8ab18713)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:13.431868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55e4c-f960-402c-9e4b-d3fb291084af admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:13.432002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:13.438484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:13.439158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.439440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.439717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] PATH_INFO: `/v3/users/428c7671c79c48f2b29f743b6e9ae6c3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.440906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428c7671c79c48f2b29f743b6e9ae6c3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:13.443125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:13.483673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7638da204fb4270b9aadc3f8ab18713'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.484300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7638da204fb4270b9aadc3f8ab18713'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.485085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7638da204fb4270b9aadc3f8ab18713'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.492098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428c7671c79c48f2b29f743b6e9ae6c3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.492244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7638da204fb4270b9aadc3f8ab18713'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.493160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428c7671c79c48f2b29f743b6e9ae6c3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.501509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428c7671c79c48f2b29f743b6e9ae6c3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.502225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428c7671c79c48f2b29f743b6e9ae6c3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.504689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da99f88c-534c-4cc7-9fe6-cc67cbf268f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7638da204fb4270b9aadc3f8ab18713'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.526697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 970/1908] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:13 2022] DELETE /identity/v3/users/c7638da204fb4270b9aadc3f8ab18713 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:13.530291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428c7671c79c48f2b29f743b6e9ae6c3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:13.549085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 939/1909] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:13 2022] DELETE /identity/v3/users/428c7671c79c48f2b29f743b6e9ae6c3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:13.553813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.554048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.554549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.575816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:13.578431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:13.661518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:13.677640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 971/1910] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:13.693069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:13.703291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:13.808870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85529c-8f19-47cc-a082-bfc38bf74863 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:13.812727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:13.813628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.813835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.814111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.827161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:13.828745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:13.840407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 940/1911] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:13.920015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:13.921621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:13.949324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf15f-f07d-4d41-a17c-ee3de6a39f2c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:13.958434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:13.959105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:13.959384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:13.959721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] PATH_INFO: `/v3/projects/0bcf5337abf84f47a2df2064622f468a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:13.961312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcf5337abf84f47a2df2064622f468a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:13.964142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:14.061505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcf5337abf84f47a2df2064622f468a', 'request_id': 'req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.068633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcf5337abf84f47a2df2064622f468a', 'request_id': 'req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.078327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcf5337abf84f47a2df2064622f468a', 'request_id': 'req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.096034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] The token cache is being invalidate because project 0bcf5337abf84f47a2df2064622f468a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:14.096963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.097864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.102814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 972/1912] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:13 2022] DELETE /identity/v3/projects/0bcf5337abf84f47a2df2064622f468a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:14.104505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:14.117236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1e87-c3ca-4111-ac9b-fe55aae6553a service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:14.150761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:14.186698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:14.188108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:14.188535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:14.188856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] PATH_INFO: `/v3/users/f076b49c8da5468ba6801f8f375ebc1c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:14.190622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f076b49c8da5468ba6801f8f375ebc1c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:14.194011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:14.246057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f076b49c8da5468ba6801f8f375ebc1c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.246761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f076b49c8da5468ba6801f8f375ebc1c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.260706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f076b49c8da5468ba6801f8f375ebc1c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.261925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f076b49c8da5468ba6801f8f375ebc1c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.287732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f076b49c8da5468ba6801f8f375ebc1c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.302829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 941/1913] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:14 2022] DELETE /identity/v3/users/f076b49c8da5468ba6801f8f375ebc1c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:14.398233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:14.400423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:14.425584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e6bd4-9544-4cd3-8283-00e02dbc1393 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:14.495564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:14.496354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:14.496668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:14.496944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] PATH_INFO: `/v3/projects/37c8aaf387314c69927162327e0b9c2d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:14.498289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c8aaf387314c69927162327e0b9c2d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:14.500343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:14.548946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c8aaf387314c69927162327e0b9c2d', 'request_id': 'req-53e22e4c-a7d6-46e1-aa77-b152bde84997'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.555211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c8aaf387314c69927162327e0b9c2d', 'request_id': 'req-53e22e4c-a7d6-46e1-aa77-b152bde84997'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.562571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c8aaf387314c69927162327e0b9c2d', 'request_id': 'req-53e22e4c-a7d6-46e1-aa77-b152bde84997'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.574275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] The token cache is being invalidate because project 37c8aaf387314c69927162327e0b9c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:14.574553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.575196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.576738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 973/1914] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:14 2022] DELETE /identity/v3/projects/37c8aaf387314c69927162327e0b9c2d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:14.580859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:14.582401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:14.602849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81a1e9-f7b5-49e2-96bb-ed9f02763668 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:14.663765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:14.664434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:14.664714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:14.665019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] PATH_INFO: `/v3/users/1ed722c51acf43a2a076b4b9755663ff` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:14.666218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed722c51acf43a2a076b4b9755663ff)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:14.668172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:14.724339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed722c51acf43a2a076b4b9755663ff'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.724929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed722c51acf43a2a076b4b9755663ff'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.729773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:14.732832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed722c51acf43a2a076b4b9755663ff'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.734038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed722c51acf43a2a076b4b9755663ff'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.750627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-008da40e-5747-4730-9aa2-abd3e7a5a6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed722c51acf43a2a076b4b9755663ff'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.764535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 942/1915] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:14 2022] DELETE /identity/v3/users/1ed722c51acf43a2a076b4b9755663ff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:14.827352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:14.828686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:14.848522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22e4c-a7d6-46e1-aa77-b152bde84997 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:14.858190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:14.914876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:14.914876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:14.914876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:14.914876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] PATH_INFO: `/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:14.929447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9322e4322b6a4e93a407b6adcf4cebc1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:14.931491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:14.983144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9322e4322b6a4e93a407b6adcf4cebc1', 'request_id': 'req-970fef03-e83c-45fa-b8b2-a315db57fcee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.989278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9322e4322b6a4e93a407b6adcf4cebc1', 'request_id': 'req-970fef03-e83c-45fa-b8b2-a315db57fcee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:14.999667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9322e4322b6a4e93a407b6adcf4cebc1', 'request_id': 'req-970fef03-e83c-45fa-b8b2-a315db57fcee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.011481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] The token cache is being invalidate because project 9322e4322b6a4e93a407b6adcf4cebc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:15.011804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.012450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.014013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 974/1916] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:14 2022] DELETE /identity/v3/projects/9322e4322b6a4e93a407b6adcf4cebc1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:15.020479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170feb7-9d2f-498d-bc16-cb41692f3c87 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.020781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170feb7-9d2f-498d-bc16-cb41692f3c87 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.021198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170feb7-9d2f-498d-bc16-cb41692f3c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.041745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8170feb7-9d2f-498d-bc16-cb41692f3c87 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.043024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8170feb7-9d2f-498d-bc16-cb41692f3c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.063149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.065746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.114014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 943/1917] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:15.122412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.122412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.122412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.150374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.151588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.161269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 944/1918] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:15.164960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.166978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fef03-e83c-45fa-b8b2-a315db57fcee admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.172654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.173325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.173676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.174675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] PATH_INFO: `/v3/projects/ec92b58103da43bb9d619e8764420f5b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.175508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec92b58103da43bb9d619e8764420f5b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.178043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.181794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734df04-e443-4cf3-9652-a7914286c07d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.188895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.190206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.190634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.191340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.193260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:15.193992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.195790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.209368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 945/1919] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:15.213793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.224155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262f9f-da31-41e3-ab59-2876f3c85023 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.230255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:15.234342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec92b58103da43bb9d619e8764420f5b', 'request_id': 'req-5852aa02-ee06-4c23-828d-4f64d4732bf1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.248353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec92b58103da43bb9d619e8764420f5b', 'request_id': 'req-5852aa02-ee06-4c23-828d-4f64d4732bf1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.258234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec92b58103da43bb9d619e8764420f5b', 'request_id': 'req-5852aa02-ee06-4c23-828d-4f64d4732bf1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.272862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] The token cache is being invalidate because project ec92b58103da43bb9d619e8764420f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:15.273182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.273951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5852aa02-ee06-4c23-828d-4f64d4732bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:15.276268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 975/1920] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:15 2022] DELETE /identity/v3/projects/ec92b58103da43bb9d619e8764420f5b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:15.281448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbca6b-bcab-4348-90f4-3d7dc4c494c1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.282149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbca6b-bcab-4348-90f4-3d7dc4c494c1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.283581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbca6b-bcab-4348-90f4-3d7dc4c494c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.302665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.303591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.303791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.304011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.309692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.309963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9ddbca6b-bcab-4348-90f4-3d7dc4c494c1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.311185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9ddbca6b-bcab-4348-90f4-3d7dc4c494c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.312008 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.321660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 976/1921] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:15.329812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.330370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.331029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.345532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 946/1922] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:15.350332 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.352212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.355020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.356194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.395827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:15.422516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4a47-8ba1-4f3a-88f3-2658eb3c9132 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.427661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.427812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 977/1923] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:15.428107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.428389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.428691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.429383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.431325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.431593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.442687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fae34-392a-40b7-a47d-8509508d1b6a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.447725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.448437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.448755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.449085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.449854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:15.450167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.451952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.459738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 947/1924] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:15.464309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 978/1925] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:15.465265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.468513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.477225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccbffc-3b82-4ebb-a930-605ee20720e0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.479276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcc01-9b3b-4f16-976a-06113f7604c4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.482182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.482835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.483040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.483271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.483963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.484402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.485148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.485498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.485618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.485841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.486574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.488563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.497117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 948/1926] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:15.500888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.510952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561919f-1556-408e-8b5d-38cf6ecbc992 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.515709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.516351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.516638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.516918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.517635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.519486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.528779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 979/1927] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:15.530931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 949/1928] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:15.532948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.534761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.545163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d273-0b24-434e-bdb8-25133b9897fb admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.594112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef847-35eb-4bdd-ae21-2b45d5c232f3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.600526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.601204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.601480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.601752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.602405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.603628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.604322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.604437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c41aec-3431-4ef6-88fd-2a07c8da19fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.604602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.604884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] PATH_INFO: `/v3/projects/c6bcd06e8d4d45149edf2241b993b4e7/users/7344e020b69645a6a1ec4fa13c433ee9/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.620624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bcd06e8d4d45149edf2241b993b4e7, user_id=7344e020b69645a6a1ec4fa13c433ee9, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.623308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.637303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 950/1929] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:15 2022] PUT /identity/v3/projects/c6bcd06e8d4d45149edf2241b993b4e7/users/7344e020b69645a6a1ec4fa13c433ee9/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:15.640163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 980/1930] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:15.649623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.652310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.653384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.654896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.712108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] MFA Rules not processed for user `7344e020b69645a6a1ec4fa13c433ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.713423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.724616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:15.725915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e1a03-92dd-49a1-a93b-f14fb38bfc04 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.735414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.736125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.736406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.737189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.737881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.739836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.754495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 951/1931] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:15.756659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.769340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38c92-e882-42cf-a95f-bfefdff8f1e9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.776801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.777725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.777909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.778237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.779048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.780796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.795609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 952/1932] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:15.796658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.805506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 981/1933] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:15.808456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b652-6f75-4828-8a5a-2b578de6c916 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.813645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.814072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.814298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.814389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.814623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] PATH_INFO: `/v3/projects/d6fc6a57fda642f7ac27b42f833395a3/users/371a185b51be4f6ba426e2caa33b613b/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.823734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:15.831415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fc6a57fda642f7ac27b42f833395a3, user_id=371a185b51be4f6ba426e2caa33b613b, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.835661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2acdd0-f96b-4655-a03b-7881ccb23d1d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.841994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60d61f-f209-47ff-82dd-7e2522674e8e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.848791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.849466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.849744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.850017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.850684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.851623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 953/1934] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:15 2022] PUT /identity/v3/projects/d6fc6a57fda642f7ac27b42f833395a3/users/371a185b51be4f6ba426e2caa33b613b/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:15.852795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.862900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.863191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.863469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.890115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 982/1935] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:15.891277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:15.901584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] MFA Rules not processed for user `371a185b51be4f6ba426e2caa33b613b`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:15.903653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:15.977319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174e55-8334-42af-8c15-bf993c77b7e0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:15.982793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:15.983460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:15.983878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:15.984166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:15.984839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:15.986871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:15.991303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 954/1936] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:15.995815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.007820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82712dc-eb24-48de-b7e0-ddcdfed73141 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.012451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.012591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 983/1937] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:16.013134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.013417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.013693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.014358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.016428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.016536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.027307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1367-506b-45de-a9dd-e6e9894cc353 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.032135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.032752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.033423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.033538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.034397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.037046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.045841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 955/1938] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:16.050364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.054359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 984/1939] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:16.055299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.065852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53d24-16a6-4397-b8ad-0bba1206c47e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.119116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afe47-9c42-45e9-b2b0-3ff90399b3f3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.124762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.125465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.125752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.126033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.126711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.128686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.132116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.132824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.133137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.133419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] PATH_INFO: `/v3/projects/5dba231bc6574844b483be98df6f8f0c/users/974daca5d8ea4567a800c38f65030792/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.146239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:16.150838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dba231bc6574844b483be98df6f8f0c, user_id=974daca5d8ea4567a800c38f65030792, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.154122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.163467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 956/1940] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:16 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:16.168148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.170797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 985/1941] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:16 2022] PUT /identity/v3/projects/5dba231bc6574844b483be98df6f8f0c/users/974daca5d8ea4567a800c38f65030792/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:16.174808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.178805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956835-98ad-4fb8-8458-88dc2e273e46 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.238742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:16.251368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd5fe-9e36-4bd1-8e32-ee2ab07f3462 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.259875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.260490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.260715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.261072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.261420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.261985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.262132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.262254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.262542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.263224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.264296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.264820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.279640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 986/1942] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:16.279995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 957/1943] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:16.282239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.283119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.295169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ec767-f55d-45de-857d-f8e8f1bcf6d5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.295446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dc65d-b3af-4b8f-bbd6-330cabbb1107 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.303011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.303826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.304106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.304334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.304441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.305150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.306062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.306587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.306924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] PATH_INFO: `/v3/projects/5dba231bc6574844b483be98df6f8f0c/users/974daca5d8ea4567a800c38f65030792/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.307066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66812385-8ecf-40b5-a34c-1dbea0c4bf80 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.310068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dba231bc6574844b483be98df6f8f0c, user_id=974daca5d8ea4567a800c38f65030792, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.313082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.334471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 987/1944] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:16 2022] PUT /identity/v3/projects/5dba231bc6574844b483be98df6f8f0c/users/974daca5d8ea4567a800c38f65030792/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:16.334956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 958/1945] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:16.336249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.338121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.338428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.338705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.375097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] MFA Rules not processed for user `974daca5d8ea4567a800c38f65030792`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:16.377822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:16.461537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0384-b383-4406-bcbc-035702152204 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.474577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.475909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.476402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.476882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] PATH_INFO: `/v3/projects/04caa54d9b9b403291c146041d8938a0/users/78b791dc62e744d5a5373c6f672b8540/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.502935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 959/1946] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:16.505878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04caa54d9b9b403291c146041d8938a0, user_id=78b791dc62e744d5a5373c6f672b8540, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.509297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64ca9e-58b0-4bfe-a9a9-9ca6152bb48a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.518265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.523642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:16.560657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 988/1947] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:16 2022] PUT /identity/v3/projects/04caa54d9b9b403291c146041d8938a0/users/78b791dc62e744d5a5373c6f672b8540/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:16.562291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.562582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.562840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.611674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] MFA Rules not processed for user `78b791dc62e744d5a5373c6f672b8540`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:16.613008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:16.621599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098a04-2ba9-4525-b6c5-f1a5dfae3867 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.694599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:16.738952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.739218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.739498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.739741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.757872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 989/1948] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:16.762272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.806888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:16.874143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.876710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.880822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539c3f9-6ceb-44d4-b31b-90e28b94fe3f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:16.885777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:16.886500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:16.886852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:16.887199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:16.887973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:16.888087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 960/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:16.893618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:16.928353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 990/1950] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:16 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:16.931438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:16.944100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71344fd-8d4f-4ad6-b36a-2aa4cee74788 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.026215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.042130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.042768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.043050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.043328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.043999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.045984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.076388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 961/1951] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:16 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:17.077207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.088521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223728bd-ffcd-40c7-b722-aff7c9eac354 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.095425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.096159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.096604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.096885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.097620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.100296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.102928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713d81-93c8-48ac-94ad-a1aca40faeec admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.106979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.107638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.107996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.108186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.109943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:17.114906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 962/1952] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:17.116781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.126916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211948ef-bb5d-40dc-9ab7-8fa6055b0c54 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.134153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.135542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.135542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.135542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] PATH_INFO: `/v3/projects/712aec6bed28417399f697dd20856728/users/5d77d4f386c2487e851733f17f8a47a1/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.154975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712aec6bed28417399f697dd20856728, user_id=5d77d4f386c2487e851733f17f8a47a1, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.159064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.179604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 963/1953] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:17 2022] PUT /identity/v3/projects/712aec6bed28417399f697dd20856728/users/5d77d4f386c2487e851733f17f8a47a1/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:17.183461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.196637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.198184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.209988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 991/1954] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:17.266931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe62e7-3a5f-4f7e-86c7-feaacbdfb552 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.272572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.273514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.273514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.273796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.274463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.276063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec15551-504f-4113-aaab-165a2effa5a7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.290096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 964/1955] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:17.291184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.302489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d204c4-1281-4ab0-9f40-a061a175ab52 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.307866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.308683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.309156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.309440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] PATH_INFO: `/v3/projects/712aec6bed28417399f697dd20856728/users/5d77d4f386c2487e851733f17f8a47a1/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.311447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=712aec6bed28417399f697dd20856728, user_id=5d77d4f386c2487e851733f17f8a47a1, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.314234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.327341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 992/1956] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:17 2022] PUT /identity/v3/projects/712aec6bed28417399f697dd20856728/users/5d77d4f386c2487e851733f17f8a47a1/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:17.340466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.341036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.341036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.363367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:17.389688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] MFA Rules not processed for user `5d77d4f386c2487e851733f17f8a47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:17.391444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:17.482361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 965/1957] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:17.491257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.501337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:17.515201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.516572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:17.594566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1525-5fd2-41ef-9fe9-986095c9c11f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.599558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b03c5-aff9-4e2e-bb42-5e11317f7c2d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:17.600559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.601973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.602281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.602664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] PATH_INFO: `/v3/users/7344e020b69645a6a1ec4fa13c433ee9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.604517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:17.605449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.605911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.606509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.606806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7344e020b69645a6a1ec4fa13c433ee9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.609139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.621536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:17.623244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5aa8-97a9-4a1d-a23d-4d6a162589bb service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:17.646446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 966/1958] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:17.706868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7344e020b69645a6a1ec4fa13c433ee9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:17.708064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7344e020b69645a6a1ec4fa13c433ee9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:17.709115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7344e020b69645a6a1ec4fa13c433ee9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:17.718329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7344e020b69645a6a1ec4fa13c433ee9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:17.747561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7344e020b69645a6a1ec4fa13c433ee9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:17.782152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 993/1959] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:17 2022] DELETE /identity/v3/users/7344e020b69645a6a1ec4fa13c433ee9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:17.787627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:17.787920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:17.788404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:17.814792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:17.816268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:17.915796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 967/1960] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:17.927016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:17.929079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:18.061727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eba405-9df9-4d65-813d-0252e05e131f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:18.069479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:18.071090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:18.071624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:18.072262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:18.088342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:18.090032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:18.108671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 994/1961] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:18.445179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:18.446736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:18.463330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6b92-1673-474f-984c-02f4e0c160f8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:18.468700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:18.470066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:18.470339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:18.470604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] PATH_INFO: `/v3/projects/c6bcd06e8d4d45149edf2241b993b4e7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:18.471753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bcd06e8d4d45149edf2241b993b4e7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:18.474335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:18.515743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:18.529721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bcd06e8d4d45149edf2241b993b4e7', 'request_id': 'req-22cfbc53-e00d-4767-ae59-9f3454abd66f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.536102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bcd06e8d4d45149edf2241b993b4e7', 'request_id': 'req-22cfbc53-e00d-4767-ae59-9f3454abd66f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.542536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bcd06e8d4d45149edf2241b993b4e7', 'request_id': 'req-22cfbc53-e00d-4767-ae59-9f3454abd66f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.549805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:18.551949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:18.556444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] The token cache is being invalidate because project c6bcd06e8d4d45149edf2241b993b4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:18.556747 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.557388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.558910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 968/1962] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:18 2022] DELETE /identity/v3/projects/c6bcd06e8d4d45149edf2241b993b4e7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:18.562690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:18.564028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:18.588716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:18.618053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b289905-65ab-4abb-98df-914df54d0f11 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:18.629472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbc53-e00d-4767-ae59-9f3454abd66f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:18.634512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:18.634985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:18.635264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:18.635543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] PATH_INFO: `/v3/users/974daca5d8ea4567a800c38f65030792` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:18.637136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974daca5d8ea4567a800c38f65030792)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:18.639069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:18.667728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:18.668354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:18.668636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:18.668955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:18.670975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:18.692532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974daca5d8ea4567a800c38f65030792'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.693238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974daca5d8ea4567a800c38f65030792'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.700124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974daca5d8ea4567a800c38f65030792'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.701118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974daca5d8ea4567a800c38f65030792'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.713743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974daca5d8ea4567a800c38f65030792'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:18.728137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 969/1963] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:18 2022] DELETE /identity/v3/users/974daca5d8ea4567a800c38f65030792 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:18.735648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:18.737114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948de67-e596-4602-af87-add48323ee3b service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:18.748772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 995/1964] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:19.057498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.058882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:19.143773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:19.178531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043f8a0-d2e0-43fb-bd8b-c24bd7795357 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.186573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.187218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.187577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.187803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] PATH_INFO: `/v3/projects/5dba231bc6574844b483be98df6f8f0c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.188948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dba231bc6574844b483be98df6f8f0c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.190999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.278475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dba231bc6574844b483be98df6f8f0c', 'request_id': 'req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:19.286112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dba231bc6574844b483be98df6f8f0c', 'request_id': 'req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:19.294426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dba231bc6574844b483be98df6f8f0c', 'request_id': 'req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:19.312599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] The token cache is being invalidate because project 5dba231bc6574844b483be98df6f8f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:19.313546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:19.314114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-23c6fc89-3f66-4939-b1c5-3506a7ba7a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:19.315970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 970/1965] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:19 2022] DELETE /identity/v3/projects/5dba231bc6574844b483be98df6f8f0c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:19.322447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.322935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.323097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.357361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:19.358672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:19.449026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 996/1966] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:19.456946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.457476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.457754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.478492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:19.479690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:19.488254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 971/1967] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:19.493127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.502946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602a676-bf9a-4791-97dc-43f1ef6899c1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.508427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.509073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.509357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.509632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.510323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:19.510626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.512211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.524057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 997/1968] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:56:19.528516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.538037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8ef2-dab6-437a-8e98-dc25867f68ec None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.542467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.543066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.543339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.543606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.544264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.546190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.573413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 972/1969] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:19 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:19.577568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.587748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9026-cdb2-48ee-b242-f3def4bee129 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.612104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:19.644524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.645194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.645477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.645883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.646542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.648450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.668998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 998/1970] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:19 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:19.673172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.684580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31c94-b01b-4549-9310-dffce9380cb5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.689184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.689796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.690079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.690347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.691024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.693949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.704301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 973/1971] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:19.708671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.718762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f471-38b4-4611-acc2-3a99d1a9aca8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.723846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.724454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.724759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.725058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.725749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.727334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b711b-cf54-42a5-a744-18c0428055d6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.737795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 999/1972] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:19.742458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.752111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49919-d417-4f8e-a721-857bf93ce267 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.757209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.757861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.758140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.758415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] PATH_INFO: `/v3/projects/8a65464847004317b898e3c9ae293c53/users/b612d4910b734a40958b00b47e885600/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.772844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a65464847004317b898e3c9ae293c53, user_id=b612d4910b734a40958b00b47e885600, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:19.775568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:19.789238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 974/1973] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:19 2022] PUT /identity/v3/projects/8a65464847004317b898e3c9ae293c53/users/b612d4910b734a40958b00b47e885600/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:19.800967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.802134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.802557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.835653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] MFA Rules not processed for user `b612d4910b734a40958b00b47e885600`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:19.836554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:19.907887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1000/1974] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:19.919591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:19.921423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:19.984491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942aa69-b87b-4f30-ab85-b2d4d4370e66 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:19.988244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:19.989485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:19.989762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:19.990029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:19.998597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:20.000209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e1f8b-62b3-440e-a08b-9d62f5e75989 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:20.010799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 975/1975] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:20.032757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:20.100047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0ac0-e1a5-4827-9892-b1c4ceca6f46 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:20.104689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:20.105385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:20.105668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:20.105943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] PATH_INFO: `/v3/users/b612d4910b734a40958b00b47e885600` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:20.107114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b612d4910b734a40958b00b47e885600)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:20.109109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:20.150314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:20.160029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b612d4910b734a40958b00b47e885600'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.161170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b612d4910b734a40958b00b47e885600'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.161892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b612d4910b734a40958b00b47e885600'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.169138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b612d4910b734a40958b00b47e885600'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.192761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b612d4910b734a40958b00b47e885600'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.217543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1001/1976] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:20 2022] DELETE /identity/v3/users/b612d4910b734a40958b00b47e885600 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:20.220041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:20.221643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:20.222032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:20.259621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:20.260818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:20.265855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:20.332500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 976/1977] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:20.364715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:20.366892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:20.471935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46784d5-0009-4a3a-a56e-fb7e48df3b3c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:20.482967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:20.483884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:20.484594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:20.485048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:20.498387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:20.499827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643bd38-9b79-49e4-8753-49d56cada34b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:20.510744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1002/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:20.885509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:20.885509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:20.894056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b64d0-5147-4dac-92d8-e6abde0727d7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:20.899723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:20.900366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:20.900643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:20.900924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] PATH_INFO: `/v3/projects/8a65464847004317b898e3c9ae293c53` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:20.902097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a65464847004317b898e3c9ae293c53)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:20.903980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:20.950694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a65464847004317b898e3c9ae293c53', 'request_id': 'req-3f216a35-7c78-4b1a-838b-4603b82e9376'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.956158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a65464847004317b898e3c9ae293c53', 'request_id': 'req-3f216a35-7c78-4b1a-838b-4603b82e9376'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.963009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a65464847004317b898e3c9ae293c53', 'request_id': 'req-3f216a35-7c78-4b1a-838b-4603b82e9376'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.976472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] The token cache is being invalidate because project 8a65464847004317b898e3c9ae293c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:20.976750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.977376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3f216a35-7c78-4b1a-838b-4603b82e9376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:20.978856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 977/1979] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:20 2022] DELETE /identity/v3/projects/8a65464847004317b898e3c9ae293c53 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:20.983686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:20.983976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:20.984302 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.004102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:21.005810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:21.066119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1003/1980] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:21.074796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.075086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.075364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.096047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:21.097336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:21.106324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 978/1981] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:21.110611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.120816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632be63-f21a-44bb-8bf8-6abd1bb3dd53 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.129118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.129118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.129118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.129118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.129489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:21.129489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.129489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.143429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1004/1982] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:21.147864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.157128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387300fc-aea4-4d67-876a-7e89b36dc06a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.165701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.166321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.166594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.166867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.167523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.169446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.196047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 979/1983] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:21.200188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.210806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4002f-e802-4f1f-9ed7-2876212f6415 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.255828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:21.274661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.275300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.275578 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.275852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.276520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.278650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.313272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1005/1984] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:21.313696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.322744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce731e-77e3-4003-9ae7-bc9856672c8d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.329660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.330387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.330698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.330999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.331790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.333990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.344576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 980/1985] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:21.348818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.359725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592ca39-ba79-45f0-b1a7-9b93bda2759d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.363203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.363848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.364132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.364709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.365125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.366795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28b349-2f7f-4291-87d8-a8893569de9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.378998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1006/1986] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:21.384281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.395801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31022-69df-42f3-8c24-85644ef870b0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.400758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.401515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.401854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.402189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] PATH_INFO: `/v3/projects/2abc9da8bcfb4cb38c5168fa2a280921/users/90f197d51d4248fc8322ae535f14d66a/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.419996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abc9da8bcfb4cb38c5168fa2a280921, user_id=90f197d51d4248fc8322ae535f14d66a, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.423723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.447011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 981/1987] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:21 2022] PUT /identity/v3/projects/2abc9da8bcfb4cb38c5168fa2a280921/users/90f197d51d4248fc8322ae535f14d66a/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:21.457439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.458323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.458660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.526583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] MFA Rules not processed for user `90f197d51d4248fc8322ae535f14d66a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:21.527976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:21.644603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1007/1988] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:21.648545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.725241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:21.782256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089681e5-06fc-475d-87be-cb357cc189d4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.790599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.791452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.791800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.792560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.793000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.795090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.831945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 982/1989] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:21.836590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:21.851899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712e5cb-8b3e-4cde-9903-c7b18465b46d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:21.962005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:21.962978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:21.963565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:21.964029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:21.965063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:21.967544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:21.997189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1008/1990] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:21 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:21.999376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.014216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9eba-d48c-4ffa-ac90-13bf87b817a7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.020206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.020940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.021298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.025693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.026372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.028229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.040963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 983/1991] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:22.044999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.055124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308deaaf-384f-4daf-9335-190894b7c13e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.059741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.060359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.060640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.060913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.061702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.063320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a706383-d90e-4bd2-81bd-d06cb9991524 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.074823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1009/1992] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:22.079170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.087350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453ae1-6d87-4f6a-ab5e-6bdc7a25f996 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.088135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453ae1-6d87-4f6a-ab5e-6bdc7a25f996 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.088924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa453ae1-6d87-4f6a-ab5e-6bdc7a25f996 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.092041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d044c-de98-4257-bc18-8024f99f0db8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.093778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1010/1993] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:56:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:56:22.100491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.101215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.101851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.102126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] PATH_INFO: `/v3/projects/14834e487b9642b2880c5856ed1d0ea9/users/4365077592834530b621ca8b5d58a318/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.107685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.107990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.109077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.122338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14834e487b9642b2880c5856ed1d0ea9, user_id=4365077592834530b621ca8b5d58a318, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.126200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97badb8-0828-4e16-82aa-88fc15da605e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.140052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:22.141897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:22.143182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 984/1994] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:22 2022] PUT /identity/v3/projects/14834e487b9642b2880c5856ed1d0ea9/users/4365077592834530b621ca8b5d58a318/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:22.155415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.156052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.156450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.173524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:22.194731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] MFA Rules not processed for user `4365077592834530b621ca8b5d58a318`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:22.196484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:22.233792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1011/1995] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:56:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:22.252268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.254901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:22.271610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d15e-d49d-43e5-b3ab-f6e737feb4e2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.278620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.279314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.283046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 985/1996] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:22.283170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.283170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.284018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.290481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.292111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.302606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1012/1997] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:22.357199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4841-a640-4b57-9294-33398904f72c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.361743 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.362371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.362857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.363250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.364610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.366558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.382800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:22.395850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 986/1998] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:22 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:22.400432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.414675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea357-e85f-48d9-a774-4cfaa7fcaaaa service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.499744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.500630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.500940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.501248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.501923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.504184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.559036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1013/1999] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:22 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:22.560373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.572051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c980f2-c839-4001-a2d8-a1f4bc2b800e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.578387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.579433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.579831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.580199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.581288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.583925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.601019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 987/2000] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:22.602639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.616999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723235f-1c07-4b73-9ab2-197494a872c7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.622249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.623029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.623310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.623674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] PATH_INFO: `/v3/projects/5f2be06d7d684603862ea1a19344d89e/users/527ab4e60be447ebb45b9b079446cceb/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.648572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2be06d7d684603862ea1a19344d89e, user_id=527ab4e60be447ebb45b9b079446cceb, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.652602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.674456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1014/2001] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:22 2022] PUT /identity/v3/projects/5f2be06d7d684603862ea1a19344d89e/users/527ab4e60be447ebb45b9b079446cceb/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:22.675605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.689933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bfa5-2a22-4bc5-9820-5bb6ef345f0b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.813329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.814106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.814643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.815016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.816038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.818397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403a8eb-f587-49f1-95e1-90b4e6af40cb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.844252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 988/2002] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:22.850177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:22.885255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecce3cd-3335-4018-bd00-554123ee69b6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:22.891442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:22.893061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.893061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.893577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] PATH_INFO: `/v3/projects/5f2be06d7d684603862ea1a19344d89e/users/527ab4e60be447ebb45b9b079446cceb/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:22.897806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2be06d7d684603862ea1a19344d89e, user_id=527ab4e60be447ebb45b9b079446cceb, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:22.904070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:22.920420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1015/2003] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:22 2022] PUT /identity/v3/projects/5f2be06d7d684603862ea1a19344d89e/users/527ab4e60be447ebb45b9b079446cceb/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:22.932241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:22.932534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:22.933011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:23.010492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] MFA Rules not processed for user `527ab4e60be447ebb45b9b079446cceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:23.012416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:23.101130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 989/2004] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:23.115031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:23.117254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:23.203873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660796a-f2a1-4b39-b06a-3a011a88f8b3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:23.212344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:23.213229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:23.213543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:23.213778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:23.229918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:23.279509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:23.280965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:23.290846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1016/2005] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:24.302034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:24.312541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633cf7-a82a-4ce7-9410-82e133fa007c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:24.325380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:24.326137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:24.326518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:24.326917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:24.329125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:24.439764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:24.448166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:24.488295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 990/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:27.978226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:27.979832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:27.992263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb11a-0a4c-4e6a-ae34-9e24df7fb5f6 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:27.996066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:27.996706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:27.996997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:27.997279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:28.058437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:28.059864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:28.070771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1017/2007] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:30.564135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:30.572499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:30.578136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7718-244b-414a-83fa-496d5b9bcc35 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:30.583006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:30.583755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:30.584032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:30.584305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:30.595110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:30.597036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601460b-0aa0-47af-9de6-c9bbd5028f86 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:30.609962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 991/2008] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:35.162727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:35.164220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:35.245703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9301-7da6-4b63-945c-c603f9b77574 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:35.250669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:35.251502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:35.251816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:35.252107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] PATH_INFO: `/v3/users/371a185b51be4f6ba426e2caa33b613b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:35.254228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=371a185b51be4f6ba426e2caa33b613b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:35.257193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:35.314305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371a185b51be4f6ba426e2caa33b613b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.315369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371a185b51be4f6ba426e2caa33b613b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.316017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371a185b51be4f6ba426e2caa33b613b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.323516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371a185b51be4f6ba426e2caa33b613b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.324658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:35.347023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371a185b51be4f6ba426e2caa33b613b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.357433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1018/2009] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:35 2022] DELETE /identity/v3/users/371a185b51be4f6ba426e2caa33b613b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:35.362026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:35.362476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:35.362577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:35.381291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:35.382453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:35.442421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 992/2010] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:35.452343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:35.453825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:35.511131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875c1c2-4e74-4790-8ddc-892ffe28e6ff admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:35.514810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:35.515455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:35.515735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:35.516038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:35.526260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:35.527684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:35.537394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1019/2011] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:35.816722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:35.818268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:35.830369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e6e07-3aff-4175-876f-2d286ce49abb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:35.835989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:35.836668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:35.836959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:35.837256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] PATH_INFO: `/v3/projects/d6fc6a57fda642f7ac27b42f833395a3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:35.838420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fc6a57fda642f7ac27b42f833395a3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:35.840314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:35.888110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fc6a57fda642f7ac27b42f833395a3', 'request_id': 'req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.893485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fc6a57fda642f7ac27b42f833395a3', 'request_id': 'req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.900001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fc6a57fda642f7ac27b42f833395a3', 'request_id': 'req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.918827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] The token cache is being invalidate because project d6fc6a57fda642f7ac27b42f833395a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:35.919065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.919714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:35.921469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 993/2012] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:35 2022] DELETE /identity/v3/projects/d6fc6a57fda642f7ac27b42f833395a3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:35.925391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:35.935787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6e02-0eec-4a52-b01b-48b601da04c3 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:35.994795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:35.995441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:35.995720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:35.995998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] PATH_INFO: `/v3/users/78b791dc62e744d5a5373c6f672b8540` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:35.997172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b791dc62e744d5a5373c6f672b8540)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:35.999077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:36.045804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b791dc62e744d5a5373c6f672b8540'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.046456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b791dc62e744d5a5373c6f672b8540'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.047059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b791dc62e744d5a5373c6f672b8540'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.055122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b791dc62e744d5a5373c6f672b8540'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.067007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b791dc62e744d5a5373c6f672b8540'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.070713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:36.082086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1020/2013] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:35 2022] DELETE /identity/v3/users/78b791dc62e744d5a5373c6f672b8540 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:36.363300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:36.364757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:36.380418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311091-b3d0-4fa2-b173-7ab9d5ffa515 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:36.456262 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:36.457562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:36.457847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:36.458123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] PATH_INFO: `/v3/projects/04caa54d9b9b403291c146041d8938a0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:36.459581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04caa54d9b9b403291c146041d8938a0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:36.461528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:36.480729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:36.513856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04caa54d9b9b403291c146041d8938a0', 'request_id': 'req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.519434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04caa54d9b9b403291c146041d8938a0', 'request_id': 'req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.526424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04caa54d9b9b403291c146041d8938a0', 'request_id': 'req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.540725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] The token cache is being invalidate because project 04caa54d9b9b403291c146041d8938a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:36.541044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.541700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.543345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 994/2014] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:36 2022] DELETE /identity/v3/projects/04caa54d9b9b403291c146041d8938a0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:36.547424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:36.549065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:36.562361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f393-cfb4-449f-8e47-cb08ea528930 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:36.624536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:36.625338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:36.625563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:36.625841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] PATH_INFO: `/v3/users/5d77d4f386c2487e851733f17f8a47a1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:36.627012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d77d4f386c2487e851733f17f8a47a1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:36.629723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:36.674174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d77d4f386c2487e851733f17f8a47a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.674934 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d77d4f386c2487e851733f17f8a47a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.676082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d77d4f386c2487e851733f17f8a47a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.684086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d77d4f386c2487e851733f17f8a47a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.700337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-85fcf9fd-23c9-4cd3-8a5d-724b9c382e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d77d4f386c2487e851733f17f8a47a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:36.714007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1021/2015] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:36 2022] DELETE /identity/v3/users/5d77d4f386c2487e851733f17f8a47a1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:37.001881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.003380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:37.032639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c0d6-6f5e-4246-94b3-f08fd69669d6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.116406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.117087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.117370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.117640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] PATH_INFO: `/v3/projects/712aec6bed28417399f697dd20856728` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.118782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712aec6bed28417399f697dd20856728)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.120676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.175142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712aec6bed28417399f697dd20856728', 'request_id': 'req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:37.181265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712aec6bed28417399f697dd20856728', 'request_id': 'req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:37.187443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712aec6bed28417399f697dd20856728', 'request_id': 'req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:37.200696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] The token cache is being invalidate because project 712aec6bed28417399f697dd20856728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:37.200974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:37.201605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90e1892f-bd5d-4fdd-bb77-2e14d8f6d3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:37.203282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 995/2016] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:37 2022] DELETE /identity/v3/projects/712aec6bed28417399f697dd20856728 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:37.209487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.209776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.210111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.230691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:37.231963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:37.292114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1022/2017] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:37.301943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.302130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.302407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.324450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:37.325730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:37.339483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 996/2018] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:37.345062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.356203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af747214-a96e-43ad-acdf-67f9a7e7dcdd None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.361568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.362199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.362484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.362850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.364677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:37.365182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.366912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.388667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1023/2019] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:56:37.393466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.405594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546a68-0a03-4d2e-a44e-c3f636f55ace None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.412005 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.413060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.413060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.413264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.414126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.416230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.451697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 997/2020] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:37 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:37.455875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.462730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:37.471133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de635e1-be4f-4538-a265-4cb9078a2be1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.532379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.533115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.533395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.533667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.534345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.537554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.559687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1024/2021] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:37 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:37.563869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.575166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098ff9-ad78-4183-a589-58676e293754 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.580132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.580759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.581125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.581337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.583318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.585032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.587462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:37.600292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 998/2022] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:37.602160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.618081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514affd4-30c2-4156-9460-9fbf54e70879 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.623398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.624013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.624293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.624564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.625356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.626963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e16d0-b817-4fc9-94ba-95b5f636cc9a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.638998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1025/2023] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:37.643139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.656303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339cb1f-d18a-4916-b342-39dc9363bc1c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.661786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.662462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.662756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.663060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] PATH_INFO: `/v3/projects/14f97891c7244cf8aa80bea9464a5688/users/35064507dbda4eaea204b2a97e33bd26/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.689659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f97891c7244cf8aa80bea9464a5688, user_id=35064507dbda4eaea204b2a97e33bd26, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.693652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.714654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 999/2024] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:37 2022] PUT /identity/v3/projects/14f97891c7244cf8aa80bea9464a5688/users/35064507dbda4eaea204b2a97e33bd26/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:37.727223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.727507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.727779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.760871 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] MFA Rules not processed for user `35064507dbda4eaea204b2a97e33bd26`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:37.762335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:37.859325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1026/2025] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:37.868722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:37.870966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:37.945750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc76a-a22f-4c17-ba68-8bd97833f0d3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:37.949765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:37.950396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:37.950676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:37.950951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:37.959652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:37.961109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:37.970859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1000/2026] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:44.510904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:44.533701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:44.536898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:44.633383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931298b-d3fd-43e5-beec-09e9e76b0a3d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:44.658920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:44.659941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:44.660405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:44.660904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] PATH_INFO: `/v3/users/35064507dbda4eaea204b2a97e33bd26` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:44.662513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35064507dbda4eaea204b2a97e33bd26)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:44.664697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:44.670756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2d76-8c15-4e02-b2bd-34eac7107b0b service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:44.681914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:44.686845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:44.687366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:44.688347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:44.688347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] PATH_INFO: `/v3/users/90f197d51d4248fc8322ae535f14d66a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:44.689656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f197d51d4248fc8322ae535f14d66a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:44.704571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:44.755571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35064507dbda4eaea204b2a97e33bd26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.756846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35064507dbda4eaea204b2a97e33bd26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.757691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35064507dbda4eaea204b2a97e33bd26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.767847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35064507dbda4eaea204b2a97e33bd26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.784843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f197d51d4248fc8322ae535f14d66a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.785984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f197d51d4248fc8322ae535f14d66a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.787792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dfd1e428-0426-40fd-8573-d7470d5467a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35064507dbda4eaea204b2a97e33bd26'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.803457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f197d51d4248fc8322ae535f14d66a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.804870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f197d51d4248fc8322ae535f14d66a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.809029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1027/2027] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:44 2022] DELETE /identity/v3/users/35064507dbda4eaea204b2a97e33bd26 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:44.810495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:44.810875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:44.811227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:44.827890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-455d269e-b354-40be-b8d7-11d50b674dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f197d51d4248fc8322ae535f14d66a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:44.833298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:44.834172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:44.835801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:44.855275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1001/2028] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:44 2022] DELETE /identity/v3/users/90f197d51d4248fc8322ae535f14d66a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:44.859784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:44.861242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:44.861625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:44.884961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:44.886387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:44.913259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1028/2029] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:44.924241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:44.926466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:44.963401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1002/2030] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:44.976170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:44.979122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:44.987434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f42bd-babe-443e-a64f-6c3325d26409 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:45.038397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:45.048370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:45.049371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:45.049829 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:45.050266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:45.056774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16788c33-2a88-4e8c-b9aa-48ff418294a5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:45.060633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:45.061521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:45.061637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:45.061850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:45.062290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:45.063787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:45.075018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1029/2031] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:45.082608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:45.084069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:45.099212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1003/2032] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:45.760566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:45.763223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:45.772656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:45.775748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:45.790301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f655fdc-1180-449c-bf85-6862606e4012 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:45.806604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872439-d0ea-4c45-bbb1-b06579c1295d service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:45.818161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:45.818888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:45.819248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:45.819855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] PATH_INFO: `/v3/projects/14f97891c7244cf8aa80bea9464a5688` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:45.821932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f97891c7244cf8aa80bea9464a5688)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:45.822280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:45.822838 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:45.823309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:45.823594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] PATH_INFO: `/v3/projects/2abc9da8bcfb4cb38c5168fa2a280921` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:45.825834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abc9da8bcfb4cb38c5168fa2a280921)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:45.829528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:45.838127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:45.937097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f97891c7244cf8aa80bea9464a5688', 'request_id': 'req-ca853349-f5c5-4983-9804-ce1a6c7811dc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.943853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f97891c7244cf8aa80bea9464a5688', 'request_id': 'req-ca853349-f5c5-4983-9804-ce1a6c7811dc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.959623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f97891c7244cf8aa80bea9464a5688', 'request_id': 'req-ca853349-f5c5-4983-9804-ce1a6c7811dc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.960068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abc9da8bcfb4cb38c5168fa2a280921', 'request_id': 'req-1d57ab63-22fa-4ea1-bc56-379bc1c26327'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.976658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abc9da8bcfb4cb38c5168fa2a280921', 'request_id': 'req-1d57ab63-22fa-4ea1-bc56-379bc1c26327'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.993217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] The token cache is being invalidate because project 14f97891c7244cf8aa80bea9464a5688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:45.993522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.994613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca853349-f5c5-4983-9804-ce1a6c7811dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:45.996375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1030/2033] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:45 2022] DELETE /identity/v3/projects/14f97891c7244cf8aa80bea9464a5688 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:45.997851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abc9da8bcfb4cb38c5168fa2a280921', 'request_id': 'req-1d57ab63-22fa-4ea1-bc56-379bc1c26327'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.006678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22fba-5eb7-4b10-82a1-f99beb71dc2a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.006964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22fba-5eb7-4b10-82a1-f99beb71dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.007242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22fba-5eb7-4b10-82a1-f99beb71dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.023861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] The token cache is being invalidate because project 2abc9da8bcfb4cb38c5168fa2a280921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:46.024397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.025532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.027937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1004/2034] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:45 2022] DELETE /identity/v3/projects/2abc9da8bcfb4cb38c5168fa2a280921 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:46.031898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.036733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.054140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-67c22fba-5eb7-4b10-82a1-f99beb71dc2a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:46.055415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-67c22fba-5eb7-4b10-82a1-f99beb71dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.087744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:46.169899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57ab63-22fa-4ea1-bc56-379bc1c26327 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.181060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.181241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.181468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.181708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] PATH_INFO: `/v3/users/4365077592834530b621ca8b5d58a318` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.183367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4365077592834530b621ca8b5d58a318)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.185765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.193990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1031/2035] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:46.201706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.202002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.202284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.239121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:46.240379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.256959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1032/2036] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:46.262577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.268007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4365077592834530b621ca8b5d58a318'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.268792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4365077592834530b621ca8b5d58a318'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.271988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712e32-ba17-485f-8e25-2269530aba4b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.278150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.278931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.279218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.279496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.280199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:46.280504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.282212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.282653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4365077592834530b621ca8b5d58a318'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.283496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4365077592834530b621ca8b5d58a318'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.299325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1033/2037] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:56:46.301246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.303668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.305306 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4365077592834530b621ca8b5d58a318'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.321924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1005/2038] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:46 2022] DELETE /identity/v3/users/4365077592834530b621ca8b5d58a318 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:46.322062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221e74-a224-4155-8e6f-d2948df67a4f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.325159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.326512 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.383795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:46.397653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.399017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.399344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.399663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] PATH_INFO: `/v3/users/ff240b8671464250a39406d6021b271b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.401104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff240b8671464250a39406d6021b271b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.403822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.406468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37b9a-2517-4cf8-8fa7-3911f7832c79 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.412044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.412690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.413174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.413457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.414135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.416345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.453876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1006/2039] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:46 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:46.455108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.468856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff240b8671464250a39406d6021b271b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.469931 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff240b8671464250a39406d6021b271b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.470680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff240b8671464250a39406d6021b271b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.479952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff240b8671464250a39406d6021b271b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.488829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:46.510696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff240b8671464250a39406d6021b271b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.529080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1034/2040] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:46 2022] DELETE /identity/v3/users/ff240b8671464250a39406d6021b271b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:46.540290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2801d6-4abd-4def-92cc-134e60926e94 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.642066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.642719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.643132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.643416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.644886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.647727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.663740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.665257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.683252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1007/2041] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:46 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:46.703686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.709245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.725823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429384-041b-44c8-ad83-8b0f49adf0f9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.731254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.731736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5861860-29f2-42a0-a095-b99f315eefb0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.732108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.732400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.732728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.733467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.736584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.748220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.749432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.752567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1008/2042] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:46.753266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.754316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] PATH_INFO: `/v3/projects/14834e487b9642b2880c5856ed1d0ea9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.754441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.758180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14834e487b9642b2880c5856ed1d0ea9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.764550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.774521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f3ac-99c0-4687-819d-746e70314a02 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.779839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.788227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.788432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.788694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.790563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.792597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.809122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1009/2043] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:46.811683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.824260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340525-8145-4771-bc0d-3de4ed02aade admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:46.830284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:46.830530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.832825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.832825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] PATH_INFO: `/v3/projects/c3750af3c19e4952853b35204991dcb6/users/e3d636ee1144420093d5b6eac0fecc71/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.849735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3750af3c19e4952853b35204991dcb6, user_id=e3d636ee1144420093d5b6eac0fecc71, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:46.852518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab2ec-1887-4f99-9f29-3d803f6eeb2e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:46.857179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14834e487b9642b2880c5856ed1d0ea9', 'request_id': 'req-371a06bd-cfc3-4113-b6b3-79920f3fb80f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.869141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14834e487b9642b2880c5856ed1d0ea9', 'request_id': 'req-371a06bd-cfc3-4113-b6b3-79920f3fb80f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.880568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14834e487b9642b2880c5856ed1d0ea9', 'request_id': 'req-371a06bd-cfc3-4113-b6b3-79920f3fb80f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.881247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1010/2044] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:46 2022] PUT /identity/v3/projects/c3750af3c19e4952853b35204991dcb6/users/e3d636ee1144420093d5b6eac0fecc71/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:46.892446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:46.892692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:46.892952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:46.897221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] The token cache is being invalidate because project 14834e487b9642b2880c5856ed1d0ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:46.898391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.899054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:46.914601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1035/2045] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:46 2022] DELETE /identity/v3/projects/14834e487b9642b2880c5856ed1d0ea9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:46.914601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:46.914601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.933834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] MFA Rules not processed for user `e3d636ee1144420093d5b6eac0fecc71`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:46.935693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:46.988403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:46.996385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a06bd-cfc3-4113-b6b3-79920f3fb80f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.030113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1011/2046] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:47.033885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.036054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.045469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:47.075513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.076160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.076446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.076721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] PATH_INFO: `/v3/users/527ab4e60be447ebb45b9b079446cceb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.077975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527ab4e60be447ebb45b9b079446cceb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.080076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.123175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135646-3c9b-492e-9588-9dedde426ac0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.128323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.129121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.129485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.129759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] PATH_INFO: `/v3/projects/2020d1be7ce64792aa4ffbabd3534dbe` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.131128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2020d1be7ce64792aa4ffbabd3534dbe)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.133208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.134889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527ab4e60be447ebb45b9b079446cceb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.135845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527ab4e60be447ebb45b9b079446cceb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.136480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527ab4e60be447ebb45b9b079446cceb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.145183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527ab4e60be447ebb45b9b079446cceb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.162242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527ab4e60be447ebb45b9b079446cceb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.177730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1036/2047] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:46 2022] DELETE /identity/v3/users/527ab4e60be447ebb45b9b079446cceb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:47.178810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.180161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.197318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2020d1be7ce64792aa4ffbabd3534dbe', 'request_id': 'req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.207531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2020d1be7ce64792aa4ffbabd3534dbe', 'request_id': 'req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.229622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2020d1be7ce64792aa4ffbabd3534dbe', 'request_id': 'req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.264114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] The token cache is being invalidate because project 2020d1be7ce64792aa4ffbabd3534dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:47.264418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.266107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.270437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1012/2048] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:47 2022] DELETE /identity/v3/projects/2020d1be7ce64792aa4ffbabd3534dbe => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:47.274982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.280324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.302507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaff2b-b735-481d-90af-813e65f28121 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.310479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.312358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.313556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.314065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.317286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.342994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:47.410778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5fd88-a9f2-4caa-9ea6-1b0b0bba0a40 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.459455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.461224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.480605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:47.481000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1037/2049] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:47.519049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.520656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.521205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.522100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] PATH_INFO: `/v3/users/a3cbce1eebf24c4abb303b9aff99b568` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.524079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cbce1eebf24c4abb303b9aff99b568)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.528041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.581133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.583288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.611619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cbce1eebf24c4abb303b9aff99b568'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.613650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cbce1eebf24c4abb303b9aff99b568'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.634612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cbce1eebf24c4abb303b9aff99b568'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.635592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cbce1eebf24c4abb303b9aff99b568'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.641920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5a0-20bd-443a-9abf-2f0a4d408064 service glance] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.656078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-67040385-53a7-478c-b5a7-400c9eaac6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cbce1eebf24c4abb303b9aff99b568'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.657530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.658309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.658621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.658870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] PATH_INFO: `/v3/projects/5f2be06d7d684603862ea1a19344d89e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.660782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2be06d7d684603862ea1a19344d89e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.662811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.687429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1013/2050] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:47 2022] DELETE /identity/v3/users/a3cbce1eebf24c4abb303b9aff99b568 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:47.730059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2be06d7d684603862ea1a19344d89e', 'request_id': 'req-0e6abd33-cc61-4286-9c88-3785d53ae356'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.737235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2be06d7d684603862ea1a19344d89e', 'request_id': 'req-0e6abd33-cc61-4286-9c88-3785d53ae356'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.749757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2be06d7d684603862ea1a19344d89e', 'request_id': 'req-0e6abd33-cc61-4286-9c88-3785d53ae356'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.764484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] The token cache is being invalidate because project 5f2be06d7d684603862ea1a19344d89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:47.764959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.766571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0e6abd33-cc61-4286-9c88-3785d53ae356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:47.772711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1038/2051] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:47 2022] DELETE /identity/v3/projects/5f2be06d7d684603862ea1a19344d89e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:47.776054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.776527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.776762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.798634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:47.799918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.872192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1014/2052] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:47.881667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.882561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.882851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.906401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.908577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.909208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:47.911091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:47.921995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1039/2053] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:47.934749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:47.937199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c551fd-f672-4351-9643-bd1493fce7a0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.944294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.945212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.945738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.946131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] PATH_INFO: `/v3/projects/b0f040e35ee64d149e01f61b06f346e2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.947618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f040e35ee64d149e01f61b06f346e2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.948787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3722-aac7-442e-82c3-f8c2a78c832d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:47.949931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.955606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:47.956242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:47.957100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:47.957470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:47.958466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:47.958766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:47.960904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:47.983857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1040/2054] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:47.998282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.017116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f040e35ee64d149e01f61b06f346e2', 'request_id': 'req-d284db98-7262-48e2-9646-b0ade26e8bab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.019869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28826f61-9589-4ed1-8496-8bc947f728ce admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.025976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:48.028611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f040e35ee64d149e01f61b06f346e2', 'request_id': 'req-d284db98-7262-48e2-9646-b0ade26e8bab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.040230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f040e35ee64d149e01f61b06f346e2', 'request_id': 'req-d284db98-7262-48e2-9646-b0ade26e8bab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.060133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] The token cache is being invalidate because project b0f040e35ee64d149e01f61b06f346e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:48.060438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.061228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d284db98-7262-48e2-9646-b0ade26e8bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.062882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1015/2055] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:47 2022] DELETE /identity/v3/projects/b0f040e35ee64d149e01f61b06f346e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:48.068409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ca64-8a74-4a85-856a-cbbecb94207a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.068770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ca64-8a74-4a85-856a-cbbecb94207a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.069210 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ca64-8a74-4a85-856a-cbbecb94207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.093849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b750ca64-8a74-4a85-856a-cbbecb94207a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:48.095636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b750ca64-8a74-4a85-856a-cbbecb94207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.115802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.116465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.116806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.117163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.118088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.120244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.158965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1041/2056] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:47 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:48.160839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.164256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.181859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:48.236328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1016/2057] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:48.245810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.246185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.246653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.264562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12250-1c1c-4330-bdec-ecd53182598a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.270366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:48.271100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.271711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.271849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.272035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.272385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.273089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.275217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.280888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1017/2058] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:48.286331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.297246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2664-2f42-447d-8d52-5ffab30d3366 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.301348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1042/2059] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:48.304156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.304808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.305537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.305819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.306094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.306794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:48.307098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.308756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.314083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545db2d-ebb8-4819-9140-4b2cf2de9943 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.319235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.319845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.320129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.320405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.324342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1018/2060] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:56:48.324479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.324479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.325529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.336809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1043/2061] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:48.337006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34d911-3185-455e-b1b2-a4c4637d5fc9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.337838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.341354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.341706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.341988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.342265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.342991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.345312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.349191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679d7f-f1ee-4f04-95ae-7047554180f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.354396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.355036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.355316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.355593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.356739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.358772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.371146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1044/2062] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:48.374556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1019/2063] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:48.375255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.378334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.385626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f424d-98b0-445e-a545-ec728179fd07 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.446267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.446947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.447223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.447493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] PATH_INFO: `/v3/projects/ab5826fedf834687be91885208773a55/users/791f6e27571e44f1a42ddd7696bfce83/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.448303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346588b8-f1b7-415a-8d36-34a252ce9243 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.453480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.454109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.454389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.454694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.455789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.458127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.462794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5826fedf834687be91885208773a55, user_id=791f6e27571e44f1a42ddd7696bfce83, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.465442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885b838-4c01-447e-97d6-068d5fdbafc5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.481325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1045/2064] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:48 2022] PUT /identity/v3/projects/ab5826fedf834687be91885208773a55/users/791f6e27571e44f1a42ddd7696bfce83/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:48.493092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.493380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.493659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.494864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1020/2065] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:48.498634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.513636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf1d0-37f9-490d-be84-d55f1b1941a4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.523937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] MFA Rules not processed for user `791f6e27571e44f1a42ddd7696bfce83`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:48.525188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.547634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:48.574259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:48.578188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.578817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.579124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.579461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.580054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.582418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.592350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1021/2066] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:48.592350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.592350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.605341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1046/2067] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:48.605341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.607308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f703-915f-46b4-bea6-845c52442acf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.613410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.614825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.615106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.615381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] PATH_INFO: `/v3/users/c70142c20c0648d3896002e2f0ed5fca` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.616594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70142c20c0648d3896002e2f0ed5fca)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.618082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b535-af24-4351-bc31-d1d940dfe2ac None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.618705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.622864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.623504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.623784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.624062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.624756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.626440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.639276 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1047/2068] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:48.640159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.642650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.674569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70142c20c0648d3896002e2f0ed5fca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.677115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70142c20c0648d3896002e2f0ed5fca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.690311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70142c20c0648d3896002e2f0ed5fca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.691133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70142c20c0648d3896002e2f0ed5fca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.732197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6e6d3-e340-4e5a-9d4c-3a680ca975fa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.734274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70142c20c0648d3896002e2f0ed5fca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:48.737211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.738487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.738487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.738487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.740654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.753925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.755536 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee773c26-9c1a-4fbd-a650-6e48297787d7 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.755717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1022/2069] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:48 2022] DELETE /identity/v3/users/c70142c20c0648d3896002e2f0ed5fca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:48.756662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.759771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.767072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1048/2070] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:48.779900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.780270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.780546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.811780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:48.820498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.852784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b16a-f287-466c-9aba-186d0ac9e342 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:48.859145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:48.859853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.860131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.860413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] PATH_INFO: `/v3/projects/74fcb5c988784cfea9e68438c6b430b5/users/53c66c0748e34bc7bfe1f199747d8475/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.883406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fcb5c988784cfea9e68438c6b430b5, user_id=53c66c0748e34bc7bfe1f199747d8475, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:48.886425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c9667-826a-41be-9646-148a04c0a135 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:48.891443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1049/2071] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:48.906004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1023/2072] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:48 2022] PUT /identity/v3/projects/74fcb5c988784cfea9e68438c6b430b5/users/53c66c0748e34bc7bfe1f199747d8475/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:48.906392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:48.908579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.919045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:48.919421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:48.919705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:48.963705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] MFA Rules not processed for user `53c66c0748e34bc7bfe1f199747d8475`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:48.965590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:48.985131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:48.990942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac761af6-3ead-414e-bfa1-f4d290d32671 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:49.033752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:49.066453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:49.069180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:49.069457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:49.069804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:49.077025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1024/2073] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:49.089752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:49.091528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:49.187830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:49.190444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:49.200472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1050/2074] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:56:49.220185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5313c8-55a7-4dab-9493-52f8ec77ae50 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:49.228372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:49.230086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:49.230875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:49.231664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:49.246733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:49.254320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:49.274018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1025/2075] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:49.559243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:49.560648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:49.582815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8511-cc41-41b5-8ed1-0a55f7ed5da2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:49.590075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:49.590827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:49.591111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:49.591381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] PATH_INFO: `/v3/projects/16e4a2390c6944b0a5a664690a74d7d4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:49.593184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e4a2390c6944b0a5a664690a74d7d4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:49.595767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:49.652735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e4a2390c6944b0a5a664690a74d7d4', 'request_id': 'req-6d531067-3991-4f0e-b9f7-fcf2af85b094'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.658768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e4a2390c6944b0a5a664690a74d7d4', 'request_id': 'req-6d531067-3991-4f0e-b9f7-fcf2af85b094'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.667033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e4a2390c6944b0a5a664690a74d7d4', 'request_id': 'req-6d531067-3991-4f0e-b9f7-fcf2af85b094'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.679868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] The token cache is being invalidate because project 16e4a2390c6944b0a5a664690a74d7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:49.680153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.680816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.682707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1051/2076] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:49 2022] DELETE /identity/v3/projects/16e4a2390c6944b0a5a664690a74d7d4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:49.687481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:49.700250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb3b2-4e6d-4dfd-b7f7-3babc8456c3b service glance] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:49.773863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:49.773863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:49.774086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:49.774364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] PATH_INFO: `/v3/users/41a0d7a0ce6f4233ab95751da3d81f8f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:49.775922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a0d7a0ce6f4233ab95751da3d81f8f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:49.778903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:49.838292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a0d7a0ce6f4233ab95751da3d81f8f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.839091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a0d7a0ce6f4233ab95751da3d81f8f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.847535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a0d7a0ce6f4233ab95751da3d81f8f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.848584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a0d7a0ce6f4233ab95751da3d81f8f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.850952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:49.862617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-904dd878-6d45-4db7-a240-3644f841f9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a0d7a0ce6f4233ab95751da3d81f8f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:49.877316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1026/2077] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:49 2022] DELETE /identity/v3/users/41a0d7a0ce6f4233ab95751da3d81f8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:50.149889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.151285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:50.185709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d531067-3991-4f0e-b9f7-fcf2af85b094 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.247623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.248433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.248719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.249048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] PATH_INFO: `/v3/projects/52891bafbc014ac18bb4da0c546629d6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.250229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52891bafbc014ac18bb4da0c546629d6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.259560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.261824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:50.304133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52891bafbc014ac18bb4da0c546629d6', 'request_id': 'req-21e6aec9-28a9-4ac7-8df4-56ed1372e033'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:50.310024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52891bafbc014ac18bb4da0c546629d6', 'request_id': 'req-21e6aec9-28a9-4ac7-8df4-56ed1372e033'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:50.317694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52891bafbc014ac18bb4da0c546629d6', 'request_id': 'req-21e6aec9-28a9-4ac7-8df4-56ed1372e033'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:50.328722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] The token cache is being invalidate because project 52891bafbc014ac18bb4da0c546629d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:50.329034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:50.329665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-21e6aec9-28a9-4ac7-8df4-56ed1372e033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:50.331169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1052/2078] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:50 2022] DELETE /identity/v3/projects/52891bafbc014ac18bb4da0c546629d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:50.336660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.342961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.342961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.356858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:50.358149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:50.417967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1027/2079] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:50.426287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.426571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.426877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.447675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:50.448866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:50.457542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1053/2080] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:50.461786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.472831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c494-c58b-4c2d-87fa-c2876b89f4bb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.478153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.478845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.479127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.479401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.480119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:50.480483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.482379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.495120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1028/2081] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:50.499287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.509162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85d86-9af4-49ce-b57c-e5b95d1528f2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.513800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.514409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.514782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.515057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.515709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.517615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.544597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1054/2082] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:50.548830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.559962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581146-bcaf-4101-880b-adf309391ce4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.616829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.617681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.617962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.618236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.618903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.620821 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.643636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1029/2083] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:50.649331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.661741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147adb-27c4-43f5-93d4-dade77a32152 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.667261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.668061 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.668344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.668683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.669546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.671229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.687199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1055/2084] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:50.691374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.703201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae735dfa-96bc-447f-a91a-d711000fa075 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.709408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.710039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.710321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.710594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.711291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.712963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c5e9-373b-4e56-8520-b918ab8d0a9c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.724966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1030/2085] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:50.729171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.740143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7f6be-027a-4603-afd8-ee27aeb1658a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.746311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.747107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.747472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.747839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] PATH_INFO: `/v3/projects/14ff7dda147048dea67843bcd6d163ce/users/cfb1eca0d6074e5996362fc7501e8ddf/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.764106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ff7dda147048dea67843bcd6d163ce, user_id=cfb1eca0d6074e5996362fc7501e8ddf, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.766837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:50.781042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1056/2086] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:50 2022] PUT /identity/v3/projects/14ff7dda147048dea67843bcd6d163ce/users/cfb1eca0d6074e5996362fc7501e8ddf/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:50.793648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.794089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.794629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.828620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] MFA Rules not processed for user `cfb1eca0d6074e5996362fc7501e8ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:50.830580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:50.865770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:50.903767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1031/2087] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:50.908630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:50.970311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144861c-c32c-410a-ab8e-74449aa83638 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:50.975167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:50.975783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:50.976062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:50.976338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:50.977034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:50.978933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.006021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1057/2088] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:50 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:51.009951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.020922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eadb0-bf9b-4230-82df-4a43f52cd6c9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.078204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.078832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.079097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.079371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.080020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.082843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.104324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1032/2089] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:51 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:51.108278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.118531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132cf3-0960-4611-b220-9c6d91d36aaf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.123115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.123723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.124002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.124278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.124966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.126571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.136901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1058/2090] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:51.140782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.151480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4156-31e0-4980-af60-221e5830f41f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.156020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.156679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.156961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.157271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] PATH_INFO: `/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e/users/f0bde503e40a4a3690603be840b01151/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.174869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e8bd1d9abc4805a89c985dafb0901e, user_id=f0bde503e40a4a3690603be840b01151, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.178085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.190721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1033/2091] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:51 2022] PUT /identity/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e/users/f0bde503e40a4a3690603be840b01151/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:51.194995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.205638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fded89-9249-4d97-a83a-22c45771d2f4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.210024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:51.274840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.275492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.275795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.276068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.276753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.278453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6497089-9960-4fe9-87e5-98efe633ce21 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.290184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1059/2092] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:51.294470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.305645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f39b6-b9de-4d8b-ab84-f6f1560a1792 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.321817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.321817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.321817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.321817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] PATH_INFO: `/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e/users/f0bde503e40a4a3690603be840b01151/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.322171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e8bd1d9abc4805a89c985dafb0901e, user_id=f0bde503e40a4a3690603be840b01151, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.322171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.327585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1034/2093] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:51 2022] PUT /identity/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e/users/f0bde503e40a4a3690603be840b01151/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:51.338435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.338724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.339002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.368016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] MFA Rules not processed for user `f0bde503e40a4a3690603be840b01151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:51.369278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:51.448755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1060/2094] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:51.460308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.462043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:51.528852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1554-0274-474c-ace8-a9d2891de653 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.532369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.532999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.533279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.533548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.542716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.544142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.553527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1035/2095] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:51.658043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:51.667323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0fea8-7e61-40e5-992c-bcea053ce0df None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:51.670890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:51.671496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:51.671776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:51.672047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:51.731320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:51.732736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefa1a1-1946-4307-93d6-60209617c498 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:51.742175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1061/2096] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:54.418101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:54.451096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:54.486268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff259b0-74fb-40dc-b46f-a712063804c0 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:54.491624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:54.492342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:54.492660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:54.493022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] PATH_INFO: `/v3/users/cfb1eca0d6074e5996362fc7501e8ddf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:54.494411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb1eca0d6074e5996362fc7501e8ddf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:54.496553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:54.546448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb1eca0d6074e5996362fc7501e8ddf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:54.547296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb1eca0d6074e5996362fc7501e8ddf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:54.555010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb1eca0d6074e5996362fc7501e8ddf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:54.555780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb1eca0d6074e5996362fc7501e8ddf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:54.569209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb1eca0d6074e5996362fc7501e8ddf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:54.584507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1036/2097] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:54 2022] DELETE /identity/v3/users/cfb1eca0d6074e5996362fc7501e8ddf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:54.589097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:54.589669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:54.589770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:54.610649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:54.611844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:54.632160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:54.675749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1062/2098] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:54.686308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:54.687723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:54.748555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04fff-285c-4ae7-8598-dff0424ec300 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:54.753173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:54.753803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:54.754088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:54.754363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:54.764087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:54.765562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:54.777474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1037/2099] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:55.103185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:55.105901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:55.133315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165ed32-1a30-499b-841f-02972aff6ff8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:55.142080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:55.142769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:55.143300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:55.144417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] PATH_INFO: `/v3/projects/14ff7dda147048dea67843bcd6d163ce` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:55.147027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ff7dda147048dea67843bcd6d163ce)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:55.151798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:55.203007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ff7dda147048dea67843bcd6d163ce', 'request_id': 'req-5ea3a368-cbed-4d1b-a791-64923d9b88e9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.209357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ff7dda147048dea67843bcd6d163ce', 'request_id': 'req-5ea3a368-cbed-4d1b-a791-64923d9b88e9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.216889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ff7dda147048dea67843bcd6d163ce', 'request_id': 'req-5ea3a368-cbed-4d1b-a791-64923d9b88e9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.228033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] The token cache is being invalidate because project 14ff7dda147048dea67843bcd6d163ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:55.228317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.228933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.230449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1063/2100] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:55 2022] DELETE /identity/v3/projects/14ff7dda147048dea67843bcd6d163ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:55.234506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:55.244235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca7bd-03c5-48aa-9370-29cce0044240 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:55.290040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:55.303225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:55.304046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:55.304324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:55.304590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] PATH_INFO: `/v3/users/f0bde503e40a4a3690603be840b01151` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:55.307582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bde503e40a4a3690603be840b01151)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:55.309596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:55.363426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bde503e40a4a3690603be840b01151'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.364167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bde503e40a4a3690603be840b01151'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.371686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bde503e40a4a3690603be840b01151'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.372370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bde503e40a4a3690603be840b01151'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.390829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c3ca0083-9fb5-412e-9c26-5e3a32c75543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bde503e40a4a3690603be840b01151'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.404208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1038/2101] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:55 2022] DELETE /identity/v3/users/f0bde503e40a4a3690603be840b01151 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:55.797803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:55.799289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:55.826236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3a368-cbed-4d1b-a791-64923d9b88e9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:55.891787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:55.892442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:55.892738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:55.893052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] PATH_INFO: `/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:55.894840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e8bd1d9abc4805a89c985dafb0901e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:55.896741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:55.944666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e8bd1d9abc4805a89c985dafb0901e', 'request_id': 'req-9ff6e1ee-ce09-4ee0-b438-61c616e86822'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.946556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:55.951757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e8bd1d9abc4805a89c985dafb0901e', 'request_id': 'req-9ff6e1ee-ce09-4ee0-b438-61c616e86822'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.960066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e8bd1d9abc4805a89c985dafb0901e', 'request_id': 'req-9ff6e1ee-ce09-4ee0-b438-61c616e86822'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.971195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] The token cache is being invalidate because project e8e8bd1d9abc4805a89c985dafb0901e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:55.971481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.972933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9ff6e1ee-ce09-4ee0-b438-61c616e86822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:55.974565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1064/2102] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:55 2022] DELETE /identity/v3/projects/e8e8bd1d9abc4805a89c985dafb0901e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:55.979608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:55.980077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:55.980175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.000271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:56.001521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:56.060465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1039/2103] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:56:56.068691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.069012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.069290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.089392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:56.090522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:56.099858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1065/2104] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:56.104146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.114816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d1c35-7bf0-4372-b96b-9b8c9a71e1f6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.119617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.120343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.120628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.120902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.121653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:56.121960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.123604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.135877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1040/2105] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:56.140148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.150483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ad8e-873c-4c91-b053-0d5fe996aad2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.156890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.157557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.157841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.158122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.158777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.161306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.190214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1066/2106] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:56 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:56.194313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.205380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfc4d0-1621-4e5f-aad2-2386d5110ad4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.258475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:56.266929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.267809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.268250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.269299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.270064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.271983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.294104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1041/2107] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:56 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:56.298338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.308885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768b688-e193-4b02-911d-6d721e521215 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.313587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.314844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.315132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.315413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.316456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.318143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.328518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1067/2108] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:56.333214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.343480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ef1e-6c85-448f-b87f-a4c5a518065e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.349974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.350631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.350916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.351191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.351879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.353557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad2e9-2413-42c8-903c-32404258417e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.366022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1042/2109] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:56.370261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.380751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6015-6f16-4e02-902b-6d8c81d564c5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.385412 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.386074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.386372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.386635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] PATH_INFO: `/v3/projects/d60f81aa54e94706a2ada2ba49b7e80d/users/4539a4632edf4dcbac2a75e043db49a9/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.401520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60f81aa54e94706a2ada2ba49b7e80d, user_id=4539a4632edf4dcbac2a75e043db49a9, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.404170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.417818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1068/2110] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:56 2022] PUT /identity/v3/projects/d60f81aa54e94706a2ada2ba49b7e80d/users/4539a4632edf4dcbac2a75e043db49a9/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:56.429374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.429676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.429931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.463553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] MFA Rules not processed for user `4539a4632edf4dcbac2a75e043db49a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:56.464938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:56.531418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1043/2111] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:56.564748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.567184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:56.634411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b28d4-364d-4a0d-976b-f77c862184c7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.639842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.640517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.640867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.641238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.653748 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.655938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276165a3-489c-4f8a-a3ed-85eb13f28594 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.669940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1069/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:56.690428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:56.773469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230d24-1614-4d13-a09e-6748b9189b96 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:56.778902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:56.779571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.779843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.780124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] PATH_INFO: `/v3/users/4539a4632edf4dcbac2a75e043db49a9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.781401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4539a4632edf4dcbac2a75e043db49a9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:56.783942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:56.882494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4539a4632edf4dcbac2a75e043db49a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:56.883140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4539a4632edf4dcbac2a75e043db49a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:56.890729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4539a4632edf4dcbac2a75e043db49a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:56.891397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4539a4632edf4dcbac2a75e043db49a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:56.901561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:56.908895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4539a4632edf4dcbac2a75e043db49a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:56.924497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1044/2113] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:56 2022] DELETE /identity/v3/users/4539a4632edf4dcbac2a75e043db49a9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:56.930376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:56.930877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:56.931060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:56.951441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:56.952742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:57.016442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1070/2114] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:57.027402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.029068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:57.088419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4880b-0234-4214-9b67-32ed5cda5759 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.092277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.092991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.093323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.093597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.103539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.104967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855d022-0233-4199-86d4-0b95e0f1c88f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.115408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1045/2115] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:57.405570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.406980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:57.421323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b4b9a-60c1-4f24-b3c3-8622fd20ac92 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.429568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.430275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.430533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.430810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] PATH_INFO: `/v3/projects/d60f81aa54e94706a2ada2ba49b7e80d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.432015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60f81aa54e94706a2ada2ba49b7e80d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.434000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.452620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:57.492380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60f81aa54e94706a2ada2ba49b7e80d', 'request_id': 'req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:57.499411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60f81aa54e94706a2ada2ba49b7e80d', 'request_id': 'req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:57.507937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60f81aa54e94706a2ada2ba49b7e80d', 'request_id': 'req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:57.519410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] The token cache is being invalidate because project d60f81aa54e94706a2ada2ba49b7e80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:57.520195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:57.520362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f10ae774-6da5-4aca-a47f-ce0deab8f3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:57.521906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1071/2116] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:57 2022] DELETE /identity/v3/projects/d60f81aa54e94706a2ada2ba49b7e80d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:57.526909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.527215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.527488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.548742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:57.550014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:57.614026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1046/2117] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:57.621866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.622155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.622433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.642810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:57.644744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:57.653091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1072/2118] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:57.657393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.668345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae03d0-a5bf-45ce-a675-fb46899ee580 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.673441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.674145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.674489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.674804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.675667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:56:57.676047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.677961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.691828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1047/2119] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:56:57.696828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.707849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56416c70-d998-42b2-b960-7ce9d5ade063 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.712759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.713455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.713734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.714005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.714741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.716649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.751805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1073/2120] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:57 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:57.754245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.766793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba664-2aad-4c02-8837-004d1de96de1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.830269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.830900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.832233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.832543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.833387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.835823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.876937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1048/2121] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:57 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:57.878218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.891299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102e73-5c86-4a6b-b306-8fda3fd29f93 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.897190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.898130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.898870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.899378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.900271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.902616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.923643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1074/2122] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:56:57.927802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.935110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:57.942094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5f66-62c7-4996-bf4c-66065663a7f7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:57.950300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:57.951361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:57.952214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:57.952465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:57.953625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:57.956036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd5805-06a0-4562-96f8-3d80a04e978d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:57.971766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1049/2123] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:57.976471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:57.990469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce232f-1e69-4773-8bcc-9b0ea4e3b373 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.003474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.005245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.005713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.006140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] PATH_INFO: `/v3/projects/e77256b19e6f4b42b46e318fac772b66/users/a200bcd3cdf54a979c9d6f45408fc209/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.027900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77256b19e6f4b42b46e318fac772b66, user_id=a200bcd3cdf54a979c9d6f45408fc209, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.031406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.059976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1075/2124] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:57 2022] PUT /identity/v3/projects/e77256b19e6f4b42b46e318fac772b66/users/a200bcd3cdf54a979c9d6f45408fc209/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:58.064352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.064784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.065078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.101073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] MFA Rules not processed for user `a200bcd3cdf54a979c9d6f45408fc209`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:58.102539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:58.172881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1050/2125] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:58.178177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.252960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6800-c55e-4332-9606-da70b016bb81 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.259547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.260196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.260628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.260948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.261725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.265288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.296906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1076/2126] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:56:58 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:56:58.298047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.309725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf68c-823b-4348-95d0-67d23e548f4d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.370808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.371557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.371963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.372220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.372935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.374951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.398983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1051/2127] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:56:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:56:58.402861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.414126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496650-3f14-4234-9121-9d4af83e5569 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.418680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.419299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.419577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.419849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.420572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.422198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.433331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1077/2128] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:58.437990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.450260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebc8a-27a3-46c3-94c7-688fb06f3ff0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.455382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.456785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.457391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.457679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] PATH_INFO: `/v3/projects/22caacb41be441278d88e456e0f425ce/users/93cc1bbdd94a486bb6f0a37bcdadffbe/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.478025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22caacb41be441278d88e456e0f425ce, user_id=93cc1bbdd94a486bb6f0a37bcdadffbe, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.480798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.498972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1052/2129] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:58 2022] PUT /identity/v3/projects/22caacb41be441278d88e456e0f425ce/users/93cc1bbdd94a486bb6f0a37bcdadffbe/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:58.499967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.511657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96342a71-e8dd-46cc-b9c6-29445cae12ac admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.521258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:58.582164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.582888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.583192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.583538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.584243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.585932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855e51-6ba0-471c-be83-933ffe3f41d5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.600400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1078/2130] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:56:58.602365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.614872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc842238-4b32-493f-8460-5a983f97b8a8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.623093 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.623852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.624094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.624372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] PATH_INFO: `/v3/projects/22caacb41be441278d88e456e0f425ce/users/93cc1bbdd94a486bb6f0a37bcdadffbe/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.626403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22caacb41be441278d88e456e0f425ce, user_id=93cc1bbdd94a486bb6f0a37bcdadffbe, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.630168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.642014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1053/2131] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:56:58 2022] PUT /identity/v3/projects/22caacb41be441278d88e456e0f425ce/users/93cc1bbdd94a486bb6f0a37bcdadffbe/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:56:58.653126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.653417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.653701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.684120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] MFA Rules not processed for user `93cc1bbdd94a486bb6f0a37bcdadffbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:58.685719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:58.740456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.742285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:58.773475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1079/2132] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:58.779745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:58.794236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:58.795732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:58.821252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63646-0150-44c2-8676-099fa726b525 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.826396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.827039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.827318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.827593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] PATH_INFO: `/v3/users/cccc7a353d5d4318882663b99ca27fb1` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.828778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccc7a353d5d4318882663b99ca27fb1)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.830856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.868028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11e557-dae8-4450-a407-b5d1358dd6ee None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:58.872580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:58.873350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.873642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.873916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.886354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccc7a353d5d4318882663b99ca27fb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:58.887157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccc7a353d5d4318882663b99ca27fb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:58.894993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccc7a353d5d4318882663b99ca27fb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:58.896181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccc7a353d5d4318882663b99ca27fb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:58.908533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-06fe73d2-8c3f-4763-b520-75b0ff4f5fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccc7a353d5d4318882663b99ca27fb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:58.922676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1054/2133] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:58 2022] DELETE /identity/v3/users/cccc7a353d5d4318882663b99ca27fb1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:58.924655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:58.928494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:58.928841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:58.929118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:58.940597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:58.942806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:58.948011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:56:58.949377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:58.953782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1080/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:59.019911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1055/2135] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:56:59.030388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:59.031991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:59.099396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e114-b804-4420-949f-3f7c91649484 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:59.167521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:59.168348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:59.168731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:59.169155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:59.180446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:59.182111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:59.196354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1081/2136] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:56:59.589031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:59.590677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:56:59.603272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c423f8-3f8e-457b-b4d2-a3fc1b9ab7ed None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:59.607948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:59.608598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:59.608876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:59.609186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] PATH_INFO: `/v3/projects/d9b3192f9cb749a898b0944b6e738a29` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:59.610344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b3192f9cb749a898b0944b6e738a29)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:59.612242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:59.658503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:59.660094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b3192f9cb749a898b0944b6e738a29', 'request_id': 'req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.667316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b3192f9cb749a898b0944b6e738a29', 'request_id': 'req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.674679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b3192f9cb749a898b0944b6e738a29', 'request_id': 'req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.688820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] The token cache is being invalidate because project d9b3192f9cb749a898b0944b6e738a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:56:59.689072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.689699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.691855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1056/2137] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:56:59 2022] DELETE /identity/v3/projects/d9b3192f9cb749a898b0944b6e738a29 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:56:59.695922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:56:59.706028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c7c8-9ac4-4aa7-8eec-0e566cc72284 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:56:59.766070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:56:59.766732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:56:59.767051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:56:59.767389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] PATH_INFO: `/v3/users/e16d0b3fd58848a49b2d71befabf53fd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:56:59.768682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16d0b3fd58848a49b2d71befabf53fd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:56:59.771196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:56:59.816687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16d0b3fd58848a49b2d71befabf53fd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.817390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16d0b3fd58848a49b2d71befabf53fd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.818041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16d0b3fd58848a49b2d71befabf53fd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.819997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:56:59.826511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16d0b3fd58848a49b2d71befabf53fd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.840521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-95c7b61d-c4d4-4ac0-9ac3-757d19de28b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16d0b3fd58848a49b2d71befabf53fd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:56:59.854643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1082/2138] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:56:59 2022] DELETE /identity/v3/users/e16d0b3fd58848a49b2d71befabf53fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:00.130922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.132538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:00.152572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae48e5-7b95-432a-ab17-b91fc82ed0ed admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.212441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.213035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.213322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.213598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] PATH_INFO: `/v3/projects/a9c279fee2c24125811fd0548cb8458e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.214752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c279fee2c24125811fd0548cb8458e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.216659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.266077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c279fee2c24125811fd0548cb8458e', 'request_id': 'req-5a894652-9c0c-40c2-a36a-9a400e6b5c31'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:00.272103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c279fee2c24125811fd0548cb8458e', 'request_id': 'req-5a894652-9c0c-40c2-a36a-9a400e6b5c31'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:00.278172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c279fee2c24125811fd0548cb8458e', 'request_id': 'req-5a894652-9c0c-40c2-a36a-9a400e6b5c31'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:00.291645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] The token cache is being invalidate because project a9c279fee2c24125811fd0548cb8458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:00.291961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:00.292585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5a894652-9c0c-40c2-a36a-9a400e6b5c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:00.294125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1057/2139] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:00 2022] DELETE /identity/v3/projects/a9c279fee2c24125811fd0548cb8458e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:00.299313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.299826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.300755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.320678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:00.322003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:00.399494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1083/2140] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:00.407692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.408228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.408659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.436366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:00.438344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:00.450057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1058/2141] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:00.454817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.465630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d27f-8c81-4a8a-afaa-a64fc202e7cd None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.470937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.472199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.472659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.473242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.473987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:00.474335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.475977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.489345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1084/2142] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:57:00.493233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.504333 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d3004-ecaf-488d-bfab-af67a19005c8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.509577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.510272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.510570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.510841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.511591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.513833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.548068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1059/2143] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:00.549516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.566094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe707-3f2f-4669-8d90-03f54f1cfaa2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.646560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.647764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.648223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.648549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.649539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.652921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.688796 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1085/2144] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/users => generated 279 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:00.689847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.701022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdf91-d8c1-4b2c-989c-a7be0ad68e50 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.707480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.708099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.708380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.708655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.709398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.711003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.721579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1060/2145] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:00.726492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.736452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d68cc6-baf9-44bd-8690-874ec2f01227 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.741077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.741696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.741965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.742235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.742921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.744492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456257-4a01-49ff-a82c-c79bed00cb2c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.755290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1086/2146] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:00.759974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.775323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b096-5321-4f55-a388-151eae41595d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:00.781046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:00.782091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.782569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.782920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] PATH_INFO: `/v3/projects/e34449c4db5448f4bd34922c12901b71/users/ce3e58f9aa8841f489ddeeb137de712f/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.799321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34449c4db5448f4bd34922c12901b71, user_id=ce3e58f9aa8841f489ddeeb137de712f, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:00.802116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:00.815327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1061/2147] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:00 2022] PUT /identity/v3/projects/e34449c4db5448f4bd34922c12901b71/users/ce3e58f9aa8841f489ddeeb137de712f/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:00.826025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:00.826361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:00.826675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:00.859382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] MFA Rules not processed for user `ce3e58f9aa8841f489ddeeb137de712f`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:00.860621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:00.884797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:00.933049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1087/2148] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:00.937795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:00.945523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:01.010832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2279d4-e721-46df-8bc5-8cc4dc7eb2ab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.015297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.015909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.016190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.016458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.017149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.019924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.046463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1062/2149] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:00 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:01.050890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.063044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991b45-99db-4db2-afb1-49946d3775db None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.121930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.122568 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.122889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.123204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.123909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.126210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.149289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1088/2150] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:01 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:01.153372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.164225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620e70-2a1a-43b8-a1d5-ead5becd69d4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.169316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.169958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.170222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.170522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.171231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.172798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.183813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1063/2151] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:01.188281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.200014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477abbc-bdb8-44f0-acd4-04096e917800 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.204701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.205395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.205709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.205988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] PATH_INFO: `/v3/projects/c27d6c98976f4d64bf8e79e08621235f/users/e55e503f81e74de3b265d3c44bc4b2dd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.223965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27d6c98976f4d64bf8e79e08621235f, user_id=e55e503f81e74de3b265d3c44bc4b2dd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.226672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.240008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1089/2152] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:01 2022] PUT /identity/v3/projects/c27d6c98976f4d64bf8e79e08621235f/users/e55e503f81e74de3b265d3c44bc4b2dd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:01.243993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.254571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647244d-f31d-4316-be3b-6eee09b436dd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.310487 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.311100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.311374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.311644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.312337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.313940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45e08-9142-49d4-91d6-6ec848a1163f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.325001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1064/2153] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:01.329324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.339559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3758-c2df-4734-ac95-2e81b237c625 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.344233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.345182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.345468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.345741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] PATH_INFO: `/v3/projects/c27d6c98976f4d64bf8e79e08621235f/users/e55e503f81e74de3b265d3c44bc4b2dd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.348356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27d6c98976f4d64bf8e79e08621235f, user_id=e55e503f81e74de3b265d3c44bc4b2dd, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.351013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.361380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1090/2154] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:01 2022] PUT /identity/v3/projects/c27d6c98976f4d64bf8e79e08621235f/users/e55e503f81e74de3b265d3c44bc4b2dd/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:01.373154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.373439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.373711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.417631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] MFA Rules not processed for user `e55e503f81e74de3b265d3c44bc4b2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:01.418833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:01.498919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:01.510111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1065/2155] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:01.521414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.523050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:01.589923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029328d6-0948-465e-9b2a-f2c8f569351d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.593604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.594226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.594750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.595025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.605394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.606845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.617520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1091/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:01.721320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:01.731502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27aad8-2ab2-4566-a39e-dd9d8c159d2b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:01.735568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:01.736330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:01.736715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:01.737115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:01.801700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:01.803281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078796a-af1e-4e73-a395-a7d4a0b463b1 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:01.814671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1066/2157] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:06.879114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:06.880579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:06.901918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:06.950666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67e7f-f3dd-4226-89cc-346c009d7db9 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:06.955415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:06.957002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:06.957431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:06.957712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] PATH_INFO: `/v3/users/a200bcd3cdf54a979c9d6f45408fc209` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:06.959063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a200bcd3cdf54a979c9d6f45408fc209)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:06.961053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:07.011666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a200bcd3cdf54a979c9d6f45408fc209'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.012650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a200bcd3cdf54a979c9d6f45408fc209'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.013311 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a200bcd3cdf54a979c9d6f45408fc209'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.020699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a200bcd3cdf54a979c9d6f45408fc209'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.039934 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a200bcd3cdf54a979c9d6f45408fc209'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.054745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1092/2158] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:06 2022] DELETE /identity/v3/users/a200bcd3cdf54a979c9d6f45408fc209 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:07.059280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:07.059730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:07.060058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:07.080412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:07.082118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:07.157570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1067/2159] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:07.168436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:07.170324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:07.238377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c057-11c9-44e2-be26-d62f2879c402 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:07.242573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:07.243217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:07.243501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:07.243776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:07.253476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:07.255263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:07.272329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1093/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:07.605769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:07.607403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:07.626402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e8a0-cf3d-49de-ac8b-f0a5aeff0492 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:07.638337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:07.639146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:07.639436 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:07.639704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] PATH_INFO: `/v3/projects/e77256b19e6f4b42b46e318fac772b66` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:07.641103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77256b19e6f4b42b46e318fac772b66)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:07.643231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:07.701880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77256b19e6f4b42b46e318fac772b66', 'request_id': 'req-9b5e8395-4ea0-4e82-a556-6661bf4090f4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.710953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77256b19e6f4b42b46e318fac772b66', 'request_id': 'req-9b5e8395-4ea0-4e82-a556-6661bf4090f4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.724857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77256b19e6f4b42b46e318fac772b66', 'request_id': 'req-9b5e8395-4ea0-4e82-a556-6661bf4090f4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.740723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] The token cache is being invalidate because project e77256b19e6f4b42b46e318fac772b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:07.741148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.741962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.744417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1068/2161] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:07 2022] DELETE /identity/v3/projects/e77256b19e6f4b42b46e318fac772b66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:07.748552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:07.759390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29cff-35c0-4fcf-92fe-7f460eca36c6 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:07.808754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:07.848275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:07.849896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:07.850554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:07.851015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] PATH_INFO: `/v3/users/93cc1bbdd94a486bb6f0a37bcdadffbe` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:07.852588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cc1bbdd94a486bb6f0a37bcdadffbe)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:07.855506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:07.914539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cc1bbdd94a486bb6f0a37bcdadffbe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.915569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cc1bbdd94a486bb6f0a37bcdadffbe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.916367 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cc1bbdd94a486bb6f0a37bcdadffbe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.925363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cc1bbdd94a486bb6f0a37bcdadffbe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.939946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ecb03c83-5d64-4c69-a2fb-c2b0968acceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cc1bbdd94a486bb6f0a37bcdadffbe'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:07.953240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1094/2162] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:07 2022] DELETE /identity/v3/users/93cc1bbdd94a486bb6f0a37bcdadffbe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:08.264960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.266563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:08.281423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8395-4ea0-4e82-a556-6661bf4090f4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.303133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:08.359067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.360243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.360532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.360810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] PATH_INFO: `/v3/projects/22caacb41be441278d88e456e0f425ce` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.362710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22caacb41be441278d88e456e0f425ce)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.364864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.439004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22caacb41be441278d88e456e0f425ce', 'request_id': 'req-8831a3d9-b816-4164-a430-c477f8c4b4a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:08.446252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22caacb41be441278d88e456e0f425ce', 'request_id': 'req-8831a3d9-b816-4164-a430-c477f8c4b4a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:08.456714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22caacb41be441278d88e456e0f425ce', 'request_id': 'req-8831a3d9-b816-4164-a430-c477f8c4b4a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:08.471495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] The token cache is being invalidate because project 22caacb41be441278d88e456e0f425ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:08.472936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:08.473610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8831a3d9-b816-4164-a430-c477f8c4b4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:08.475486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1069/2163] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:08 2022] DELETE /identity/v3/projects/22caacb41be441278d88e456e0f425ce => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:08.481506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.481980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.482455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.506023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:08.508304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:08.597756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1095/2164] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:08.609345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.609735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.610201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.634664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:08.635859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:08.646378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1070/2165] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:08.650747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.661176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65fef-16c0-4519-8fe1-842b5a532159 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.666239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.667265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.667546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.667817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.668519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:08.668820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.670477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.685463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1096/2166] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:57:08.690704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.703125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28bade-4212-4975-8d3c-1d2f6e6f913d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.709895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.710664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.710946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.711217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.711919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.714533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.751146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1071/2167] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:08 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:08.756003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.766640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2073b-128c-4edc-b562-31955c847a44 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.820690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:08.838227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.838921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.839201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.839473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.840196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.842215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.872835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1097/2168] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:08 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:08.876096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.889560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339076-b1f2-4fc1-b8dc-f9db19894ed4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.895753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.896631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.896914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.897327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.898434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.900463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.915086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1072/2169] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:08.920091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.933304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbf6b-15f6-4238-9f31-61e934860e07 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.938288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.938924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.939355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.939729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:08.941595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:08.944126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eae00-1548-4fdc-beea-c9d39a1a3d08 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:08.958224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1098/2170] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:08.963319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:08.976964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579d22-1b90-4b21-a883-94b9ac2d6fab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:08.993590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:08.994774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:08.994774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:08.995097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] PATH_INFO: `/v3/projects/b061506a37754860b77ad1a3a39fbbb9/users/ccd098b984864ff3a6348b04931711c5/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:09.017229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b061506a37754860b77ad1a3a39fbbb9, user_id=ccd098b984864ff3a6348b04931711c5, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:09.020773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:09.051107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1073/2171] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:08 2022] PUT /identity/v3/projects/b061506a37754860b77ad1a3a39fbbb9/users/ccd098b984864ff3a6348b04931711c5/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:09.063250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:09.063587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:09.064091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:09.107386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] MFA Rules not processed for user `ccd098b984864ff3a6348b04931711c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:09.108631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:09.200018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1099/2172] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:09.208401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:09.210331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:09.275289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:09.283583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c08b9e-a0eb-41e7-ba90-18e8a5940778 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:09.292723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:09.293404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:09.293682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:09.293955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:09.305193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:09.306652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce0550-9514-4518-b754-072024997ca7 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:09.315986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1074/2173] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:11.955179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:11.957321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:12.025020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046536f2-9f30-42ef-9db0-e1d98db8a3cc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:12.029628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:12.030294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:12.030575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:12.030849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] PATH_INFO: `/v3/users/791f6e27571e44f1a42ddd7696bfce83` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:12.032050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791f6e27571e44f1a42ddd7696bfce83)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:12.035142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:12.093414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791f6e27571e44f1a42ddd7696bfce83'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:12.094152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791f6e27571e44f1a42ddd7696bfce83'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:12.095005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791f6e27571e44f1a42ddd7696bfce83'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:12.102468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791f6e27571e44f1a42ddd7696bfce83'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:12.103595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:12.118740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791f6e27571e44f1a42ddd7696bfce83'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:12.132600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1100/2174] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:11 2022] DELETE /identity/v3/users/791f6e27571e44f1a42ddd7696bfce83 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:12.137238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:12.137728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:12.137970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:12.158724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:12.160270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:12.248235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1075/2175] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:12.258896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:12.260287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:12.342776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da054ee-f7b4-475f-be50-091726a4e8e6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:12.348316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:12.349215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:12.349333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:12.349840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:12.359588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:12.361157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1992b4-415f-4134-9bd1-f6b03e5b84f2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:12.373579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1101/2176] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:13.237360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.241473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.262578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a53c3-60a2-4da6-a0f5-f42c41700012 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.270145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.272063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.273407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.274360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] PATH_INFO: `/v3/projects/ab5826fedf834687be91885208773a55` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.276320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5826fedf834687be91885208773a55)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.279156 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.354858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5826fedf834687be91885208773a55', 'request_id': 'req-83b514d9-7569-459d-929a-7cf4294293ab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.361768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5826fedf834687be91885208773a55', 'request_id': 'req-83b514d9-7569-459d-929a-7cf4294293ab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.374852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5826fedf834687be91885208773a55', 'request_id': 'req-83b514d9-7569-459d-929a-7cf4294293ab'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.387628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] The token cache is being invalidate because project ab5826fedf834687be91885208773a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:13.388227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.388869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.390557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1076/2177] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:13 2022] DELETE /identity/v3/projects/ab5826fedf834687be91885208773a55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:13.398545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d5c17-2143-42c1-a203-6e11689fd7d5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.399049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d5c17-2143-42c1-a203-6e11689fd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.399148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d5c17-2143-42c1-a203-6e11689fd7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.420265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.421924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.422069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-290d5c17-2143-42c1-a203-6e11689fd7d5 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:13.423444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-290d5c17-2143-42c1-a203-6e11689fd7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.499169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1102/2178] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:13.507988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.508280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.508659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.516847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b514d9-7569-459d-929a-7cf4294293ab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.527161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.527879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.528220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.528746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] PATH_INFO: `/v3/users/8e523d7501c345fab9071f1075ed63eb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.530023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e523d7501c345fab9071f1075ed63eb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.532017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.532450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:13.534032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.549278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:13.554601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1103/2179] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:13.561809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.573277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1d390-7680-4161-9157-ed1986d25e02 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.578639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.579263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.584666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.584666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.584666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:13.584666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.584666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.598159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1104/2180] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:57:13.602614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.604579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e523d7501c345fab9071f1075ed63eb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.605351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e523d7501c345fab9071f1075ed63eb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.613282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e523d7501c345fab9071f1075ed63eb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.613699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e057-55a6-4099-9857-fb9aba9d2e83 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.613960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e523d7501c345fab9071f1075ed63eb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.618646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.619258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.619633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.619905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.620590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.622549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.626792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e523d7501c345fab9071f1075ed63eb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.641549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1077/2181] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:13 2022] DELETE /identity/v3/users/8e523d7501c345fab9071f1075ed63eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:57:13.651139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1105/2182] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:13.655026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.656455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.736815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9697be-4f52-4f2f-9c57-4db74b45c034 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.812760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.813612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.813751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.814044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.814938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.817875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.841289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1078/2183] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:13 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:13.845824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.847153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.848125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:13.865497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60122524-c340-491f-8052-4e103bc9a463 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.867028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c4d6-b6cc-4e48-9c67-e8176bbc0f80 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.871669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.871807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.872342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.872472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.872627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.872768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.872895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] PATH_INFO: `/v3/projects/4c5780c329a5465bb96915914dd905ba` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.873030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.873800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.874221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5780c329a5465bb96915914dd905ba)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.875339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.876382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.887002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1079/2184] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:57:13.890532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.901797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2add81-3ea4-4955-8066-cd6b6af000d0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.907473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:13.908503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.908816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.909266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:13.910439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:13.912800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:13.919893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:13.927670 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1080/2185] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:57:13.931944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:13.937186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5780c329a5465bb96915914dd905ba', 'request_id': 'req-26f4e21f-95a8-4d1f-8524-6c082167d486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.943080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb6a8-99e9-4f50-8d41-a2cbc196d6ee admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:13.943365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5780c329a5465bb96915914dd905ba', 'request_id': 'req-26f4e21f-95a8-4d1f-8524-6c082167d486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.948535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:13.951259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5780c329a5465bb96915914dd905ba', 'request_id': 'req-26f4e21f-95a8-4d1f-8524-6c082167d486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.970804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] The token cache is being invalidate because project 4c5780c329a5465bb96915914dd905ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:13.971095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.972222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26f4e21f-95a8-4d1f-8524-6c082167d486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:13.973840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1106/2186] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:13 2022] DELETE /identity/v3/projects/4c5780c329a5465bb96915914dd905ba => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:13.978652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e954-133e-4a95-a310-dadd2b72b817 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:13.978975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e954-133e-4a95-a310-dadd2b72b817 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:13.979260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e954-133e-4a95-a310-dadd2b72b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.003500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-caf4e954-133e-4a95-a310-dadd2b72b817 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:14.004878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-caf4e954-133e-4a95-a310-dadd2b72b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:14.014422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.015152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.017350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.017964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] PATH_INFO: `/v3/projects/e842e3915ee840a3b98723ac207bc8b3/users/25435bfe949540b98325f6cd0945cb7d/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.035087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e842e3915ee840a3b98723ac207bc8b3, user_id=25435bfe949540b98325f6cd0945cb7d, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.037885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f470ce-4c9f-4a06-b9ac-afa0ea718993 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.052400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1081/2187] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:13 2022] PUT /identity/v3/projects/e842e3915ee840a3b98723ac207bc8b3/users/25435bfe949540b98325f6cd0945cb7d/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:57:14.057233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.057524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.057803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.065651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1107/2188] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:14.074216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.074503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.074784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.077581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:14.078791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:14.108128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:14.110751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:14.152628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1082/2189] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:14.163346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.165171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:14.219461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1108/2190] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:14.224206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.260096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29046be-c693-434a-93fd-d91efc8993f0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.265701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.266359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.266644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.266935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.267631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:14.267941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.269855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.280718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70f69-7c01-40bb-9dfb-d2925a8b4625 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.285159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1109/2191] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:57:14.291644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.293319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.294094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.294448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.294837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.311245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.321020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.321207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaddec-651a-4e49-bdd2-cb051b3c7c61 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.328260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1083/2192] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:14.332389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.333060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.333345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.334018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.334340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.336263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.374654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1110/2193] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:14 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:14.375787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.386873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0de5a-5e20-4745-973f-d91a777d1007 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.426396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:14.463454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.464548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.465107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.465620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.466563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.468959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.500394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1084/2194] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:14 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:14.505417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.516166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f3292-28b6-4482-be4f-618a97c96010 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.521603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.522443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.522727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.523004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.523765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.525430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.541202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1111/2195] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:14.542482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.580581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3b5b3-290d-4a19-bb74-5e981d2d63d3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.587290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.587917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.588240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.588514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.589266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.592383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a99f29-bf80-4689-b97b-b3181ddf44fa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.604078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1085/2196] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:14.608752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.626669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ed4a-d8cc-4e38-b413-73ab9a0b7272 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.634951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.636040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.637006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.637396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] PATH_INFO: `/v3/projects/58b58385712b4b85871073c41ba79d5f/users/c03cd88d3da44d0f8b067d9140c225bc/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.656141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:14.672971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b58385712b4b85871073c41ba79d5f, user_id=c03cd88d3da44d0f8b067d9140c225bc, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.677241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.705294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1112/2197] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:14 2022] PUT /identity/v3/projects/58b58385712b4b85871073c41ba79d5f/users/c03cd88d3da44d0f8b067d9140c225bc/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:14.711389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36d489-1b13-4e16-9edb-bc555510a9ab None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.711717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36d489-1b13-4e16-9edb-bc555510a9ab None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.712095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36d489-1b13-4e16-9edb-bc555510a9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.737349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4d36d489-1b13-4e16-9edb-bc555510a9ab None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:14.738959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4d36d489-1b13-4e16-9edb-bc555510a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:14.854075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1086/2198] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:14.864699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:14.924256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0b6fe-5eb1-491d-b958-0044e14d6caf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:14.928506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:14.929184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:14.929477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:14.929749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:14.938989 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:14.941269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:14.951679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1113/2199] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:20.539405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:20.540678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:20.541174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:20.634701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] MFA Rules not processed for user `25435bfe949540b98325f6cd0945cb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:20.641924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:20.876788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1087/2200] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:20.881324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:20.883686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:20.899840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f390fc-de4d-46d0-91c0-3c32d50ac380 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:20.906904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:20.908022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:20.908589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:20.909728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:20.910888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:20.917175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:20.958399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1114/2201] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:20 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:20.962021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:20.989455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6ea3-5e3a-4b2d-bfec-cb75500c84e8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:21.085770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:21.109572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:21.110266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.110614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.110953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:21.111826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:21.114937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:21.148572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1088/2202] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:20 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:21.150880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:21.166657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5403b84-ac61-41cd-be99-16694730fccf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:21.172255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:21.173006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.173357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.173710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:21.174928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:21.176859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:21.189242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1115/2203] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:21.193630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:21.206919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc45a-ce23-49bc-9f06-ab9d6124cc00 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:21.213562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:21.215152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.215659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.216029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] PATH_INFO: `/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7/users/f2d8fa2bc46b4092b93735d123c13233/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:21.239191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cb70981e6d4bb0a2f2a6b3d3caf8a7, user_id=f2d8fa2bc46b4092b93735d123c13233, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:21.243788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:21.267347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1089/2204] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:21 2022] PUT /identity/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7/users/f2d8fa2bc46b4092b93735d123c13233/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:21.271075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:21.282925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ac43-d46a-4f4e-b330-cb1135fbfcfe admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:21.368170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:21.368718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.369019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.369298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:21.369999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:21.371700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be367e3a-84b8-472a-9e65-f6ae90f00b11 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:21.384447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1116/2205] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:21.388678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:21.401545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab53225-ba30-4aed-a82a-aea3a8148438 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:21.407071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:21.411249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.411249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.412666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] PATH_INFO: `/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7/users/f2d8fa2bc46b4092b93735d123c13233/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:21.417251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cb70981e6d4bb0a2f2a6b3d3caf8a7, user_id=f2d8fa2bc46b4092b93735d123c13233, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:21.419047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:21.446618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1090/2206] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:21 2022] PUT /identity/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7/users/f2d8fa2bc46b4092b93735d123c13233/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:21.993336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:21.993850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:21.993850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:22.064512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] MFA Rules not processed for user `c03cd88d3da44d0f8b067d9140c225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:22.066422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:22.191606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:22.248083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1117/2207] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:22.270314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:22.272348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:22.388798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08f5ff-421c-407a-8663-77b8f5a3ca61 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:22.411843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:22.413749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:22.414185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:22.414407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:22.433489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:22.435900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796d26-3ef8-4b57-bda4-e0fb829be515 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:22.453396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1091/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:23.916248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:23.918139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:24.197128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46970e2-a8c3-4396-a1be-a3b6cc7b3e82 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:24.230556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:24.239567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:24.240804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:24.241465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] PATH_INFO: `/v3/users/ce3e58f9aa8841f489ddeeb137de712f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:24.244736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3e58f9aa8841f489ddeeb137de712f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:24.251600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:24.427134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3e58f9aa8841f489ddeeb137de712f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:24.432733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3e58f9aa8841f489ddeeb137de712f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:24.433846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3e58f9aa8841f489ddeeb137de712f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:24.457519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3e58f9aa8841f489ddeeb137de712f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:24.506235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3e58f9aa8841f489ddeeb137de712f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:24.536687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1118/2209] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:23 2022] DELETE /identity/v3/users/ce3e58f9aa8841f489ddeeb137de712f => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:24.541122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:24.541629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:24.541868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:24.608648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:24.617564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:24.824064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1092/2210] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:24.831541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:24.833585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:24.918636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33825f4-f908-432b-9f6b-72114ca804ce admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:24.924599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:24.925655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:24.926288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:24.926727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:24.939494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:24.942336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:24.954921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1119/2211] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:25.301116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:25.302790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:25.318361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975c53-122f-4ee8-95f9-fc19f691a07d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:25.333677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:25.334548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:25.335370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:25.336111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] PATH_INFO: `/v3/projects/e34449c4db5448f4bd34922c12901b71` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:25.338864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34449c4db5448f4bd34922c12901b71)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:25.341517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:25.362940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:25.406694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34449c4db5448f4bd34922c12901b71', 'request_id': 'req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.414421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34449c4db5448f4bd34922c12901b71', 'request_id': 'req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.422927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34449c4db5448f4bd34922c12901b71', 'request_id': 'req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.439584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] The token cache is being invalidate because project e34449c4db5448f4bd34922c12901b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:25.440584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.442466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.445523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1093/2212] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:25 2022] DELETE /identity/v3/projects/e34449c4db5448f4bd34922c12901b71 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:25.451139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:25.470033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478eea8-7bea-4cf5-b86b-75ce22d63977 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:25.476858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:25.566870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:25.567812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:25.568194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:25.568769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] PATH_INFO: `/v3/users/e55e503f81e74de3b265d3c44bc4b2dd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:25.570616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55e503f81e74de3b265d3c44bc4b2dd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:25.574414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:25.669052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55e503f81e74de3b265d3c44bc4b2dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.669052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55e503f81e74de3b265d3c44bc4b2dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.669643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55e503f81e74de3b265d3c44bc4b2dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.685495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55e503f81e74de3b265d3c44bc4b2dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.713979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a71d9cd2-14dc-4560-aafa-0de1e8988ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55e503f81e74de3b265d3c44bc4b2dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:25.756700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1120/2213] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:25 2022] DELETE /identity/v3/users/e55e503f81e74de3b265d3c44bc4b2dd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:57:26.608925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:26.610515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:26.644048 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22967-d15a-47d2-97e9-4c8ada9f2db5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:26.799674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:26.800378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:26.800719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:26.801152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] PATH_INFO: `/v3/projects/c27d6c98976f4d64bf8e79e08621235f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:26.802907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27d6c98976f4d64bf8e79e08621235f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:26.805576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:26.925149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27d6c98976f4d64bf8e79e08621235f', 'request_id': 'req-0aa262a1-bcca-44af-bf86-d8a1041dda47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:26.963872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27d6c98976f4d64bf8e79e08621235f', 'request_id': 'req-0aa262a1-bcca-44af-bf86-d8a1041dda47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:26.976533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27d6c98976f4d64bf8e79e08621235f', 'request_id': 'req-0aa262a1-bcca-44af-bf86-d8a1041dda47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:27.018305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] The token cache is being invalidate because project c27d6c98976f4d64bf8e79e08621235f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:27.019598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:27.020591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0aa262a1-bcca-44af-bf86-d8a1041dda47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:27.026086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1094/2214] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:26 2022] DELETE /identity/v3/projects/c27d6c98976f4d64bf8e79e08621235f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:27.039190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdde9-72f8-4026-8f95-59bcf493a904 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.043921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdde9-72f8-4026-8f95-59bcf493a904 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.044451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdde9-72f8-4026-8f95-59bcf493a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.118477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2f9bdde9-72f8-4026-8f95-59bcf493a904 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:27.119746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f9bdde9-72f8-4026-8f95-59bcf493a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:27.193030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.193516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.196656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.239256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] MFA Rules not processed for user `c03cd88d3da44d0f8b067d9140c225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:27.241415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:27.295103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1121/2215] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:27.303713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.304420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.304665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:27.304784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.338164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:27.339386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:27.348335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1122/2216] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:27.352052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1095/2217] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:27.352613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.366654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7557-4293-4316-af30-e0d5440f3fb8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.374708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.375545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.376038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.376539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.378172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:27.378720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.380525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.394811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1123/2218] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:57:27.399034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.411275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f324-ad54-412b-a7c8-80b8edee7414 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.416834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.417545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.417825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.418106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.418770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.421384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.481320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1096/2219] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:27.481561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.493053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def78e2-cbd2-4097-8542-a785d1a19423 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.497663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:27.584388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.585637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.585922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.586199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.587148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.590114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.649157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1124/2220] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:27.650769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.687734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15473f7d-70f0-4f9e-b1c8-d1631d455b0f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.709311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.709955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.710230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.710497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.713505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.718761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.750930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.764213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1097/2221] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:27.765667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5849b-a889-447d-ad63-a88055a2079e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.771640 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.772273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.773814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.781123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.781899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.783898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262441d-cd3d-4abc-ba3b-d9a387585597 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.806616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:27.816753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1125/2222] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:27.818707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8464b-0800-4a45-a2c0-9361c28a58c4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:27.824679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:27.825419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.825684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.825956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] PATH_INFO: `/v3/projects/c19dd388649d49cb8cac767637aa73b0/users/9fe4eae6128a4aec9f66e5fc6975c786/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.849495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19dd388649d49cb8cac767637aa73b0, user_id=9fe4eae6128a4aec9f66e5fc6975c786, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:27.853854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:27.872303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1098/2223] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:27 2022] PUT /identity/v3/projects/c19dd388649d49cb8cac767637aa73b0/users/9fe4eae6128a4aec9f66e5fc6975c786/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:27.887003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:27.887370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:27.887803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:27.930095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] MFA Rules not processed for user `9fe4eae6128a4aec9f66e5fc6975c786`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:27.931379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:28.099702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1126/2224] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:28.105965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.188870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976388-b307-47d0-85fa-c209beb2f909 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.194401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.195171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.195546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.195916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.196680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.199313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.282604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1099/2225] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:28 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:28.286707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.314223 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e88b-4ca5-456d-8c0e-8a813808fa2a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.444998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.446087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.446389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.447379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.449271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.455011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.523841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1127/2226] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:28 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:57:28.527586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.540951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2b23-1abc-43a4-9e46-cb98922bfb03 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.546938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.547714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.548070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.548357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.550449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.552371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.586914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.595117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:28.597533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1100/2227] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:28.601020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8e9f-6de7-4d93-98bf-97f0df9204cb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.617757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.618565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.618727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.619005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] PATH_INFO: `/v3/projects/6bc9c4f941f64171984d69201a7bae58/users/ab0d43d025c244a28bbdf709f82c5d81/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.655932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc9c4f941f64171984d69201a7bae58, user_id=ab0d43d025c244a28bbdf709f82c5d81, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.661994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.704298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.704813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1128/2228] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:28 2022] PUT /identity/v3/projects/6bc9c4f941f64171984d69201a7bae58/users/ab0d43d025c244a28bbdf709f82c5d81/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:28.716859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bc316-41b4-4a93-9085-b3eac9f99a93 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.803415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:28.818228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.819144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.819585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.820007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.820843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.822644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4da7-eec4-45bc-98f6-c86ca29d5a7b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.855762 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1101/2229] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:28.864466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:28.890002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f074-11ec-48fc-a4e1-2b093917d3de admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:28.909294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:28.914393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.914938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.915520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] PATH_INFO: `/v3/projects/6bc9c4f941f64171984d69201a7bae58/users/ab0d43d025c244a28bbdf709f82c5d81/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:28.921182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc9c4f941f64171984d69201a7bae58, user_id=ab0d43d025c244a28bbdf709f82c5d81, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:28.925659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:28.967854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1129/2230] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:28 2022] PUT /identity/v3/projects/6bc9c4f941f64171984d69201a7bae58/users/ab0d43d025c244a28bbdf709f82c5d81/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:28.976709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:28.977943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:28.978660 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:29.053245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] MFA Rules not processed for user `ab0d43d025c244a28bbdf709f82c5d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:29.055211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:29.303009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1102/2231] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:29.324565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:29.326942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:29.547576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972c68-8d38-42b8-b4e4-8b4d2b8d8c81 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:29.552215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:29.552906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:29.553205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:29.554652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:29.586879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:29.593690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93261ba-fa5a-4d53-a7eb-ff5d483f2427 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:29.626392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1130/2232] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:57:29.781249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:29.796367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62c43-07d4-4b51-8727-29cda0bba262 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:29.804390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:29.805177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:29.805424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:29.805773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:29.898750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:29.900421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:29.928263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1103/2233] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:31.022184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eeb9b-62c1-4826-98fd-2d64a84c6df6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:31.022720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eeb9b-62c1-4826-98fd-2d64a84c6df6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:31.022833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eeb9b-62c1-4826-98fd-2d64a84c6df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:31.106034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fa0eeb9b-62c1-4826-98fd-2d64a84c6df6 None None] MFA Rules not processed for user `f2d8fa2bc46b4092b93735d123c13233`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:31.107560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fa0eeb9b-62c1-4826-98fd-2d64a84c6df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:31.320129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1131/2234] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:31.788849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:31.790572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:31.964368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297f75-8834-44ba-b809-2d697458184b service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:31.974529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:31.975765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:31.976430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:31.976709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:31.979084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:32.031139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:32.188492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:32.195924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:32.253458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1104/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:33.821255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc5f3-0b99-42c1-885f-7ea1b537539f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:33.821784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc5f3-0b99-42c1-885f-7ea1b537539f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:33.821784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc5f3-0b99-42c1-885f-7ea1b537539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:33.841362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-89bfc5f3-0b99-42c1-885f-7ea1b537539f None None] MFA Rules not processed for user `25435bfe949540b98325f6cd0945cb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:33.842639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-89bfc5f3-0b99-42c1-885f-7ea1b537539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:33.849774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1132/2236] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:38.743897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:38.746126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:38.830095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdb70c-cecf-40c5-be35-0b301f873837 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:38.835104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:38.835889 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:38.836173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:38.836619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] PATH_INFO: `/v3/users/53c66c0748e34bc7bfe1f199747d8475` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:38.838089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c66c0748e34bc7bfe1f199747d8475)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:38.840294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:38.898810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c66c0748e34bc7bfe1f199747d8475'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:38.899563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c66c0748e34bc7bfe1f199747d8475'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:38.915964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c66c0748e34bc7bfe1f199747d8475'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:38.916771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c66c0748e34bc7bfe1f199747d8475'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:38.936390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c66c0748e34bc7bfe1f199747d8475'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:38.956593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1105/2237] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:38 2022] DELETE /identity/v3/users/53c66c0748e34bc7bfe1f199747d8475 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:38.960787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:38.961371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:38.961643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:38.986523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:38.988015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:39.056645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:39.089902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1133/2238] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:39.102977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:39.104647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:39.147616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:39.174392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49338-d5b2-4dc5-b45f-30271313febf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:39.178014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:39.178636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.178919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.179190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.188822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:39.190843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b13a-ee65-41c8-bb84-ab0a5f3cf729 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:39.200641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1106/2239] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:39.516253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:39.517849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:39.531180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34172d2-1859-48ad-9928-f42a56befd10 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:39.537794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:39.538611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.538891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.539165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] PATH_INFO: `/v3/projects/74fcb5c988784cfea9e68438c6b430b5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.540507 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fcb5c988784cfea9e68438c6b430b5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:39.542867 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:39.599191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fcb5c988784cfea9e68438c6b430b5', 'request_id': 'req-5bd08c88-f04e-4b7f-b594-f6cbbe796022'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:39.605287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fcb5c988784cfea9e68438c6b430b5', 'request_id': 'req-5bd08c88-f04e-4b7f-b594-f6cbbe796022'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:39.613494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fcb5c988784cfea9e68438c6b430b5', 'request_id': 'req-5bd08c88-f04e-4b7f-b594-f6cbbe796022'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:39.624719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] The token cache is being invalidate because project 74fcb5c988784cfea9e68438c6b430b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:39.625031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:39.625666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5bd08c88-f04e-4b7f-b594-f6cbbe796022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:39.627283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1134/2240] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:39 2022] DELETE /identity/v3/projects/74fcb5c988784cfea9e68438c6b430b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:39.632408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.632696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.633004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.670569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:39.672676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:39.848218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1107/2241] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:39.856235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.856534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.856836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.886396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:39.887441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:39.903167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1135/2242] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:39.907774 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:39.917798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d2ca8-37d1-4dfa-9534-419b72a481b4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:39.923110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:39.924354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.924626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.924906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.925655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:57:39.925939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:39.927569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:39.941023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1108/2243] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:57:39.945187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:39.954479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36c73b-abb7-49eb-babb-fcdcc7ed2b39 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:39.959400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:39.960050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:39.960303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:39.960580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:39.961352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:39.963246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:39.991915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1136/2244] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:39.996127 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:40.007644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5fe8-8744-46ff-9c98-416b0a54d250 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:40.067490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:40.068160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.068462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.068755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.069462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:40.071469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:40.097894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1109/2245] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:57:39 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:57:40.098975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:40.109443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c174-c24d-4256-97f9-f1797df95e9c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:40.115122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:40.115745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.116038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.116277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.116968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:40.118920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:40.133843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1137/2246] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:40.135034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:40.146467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce896075-e1fb-4c2d-a32e-4b9fe1ddad27 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:40.156327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:40.157419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.158142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.158609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.159688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:40.161887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da719b-afcc-4b6a-8e77-d98511c01546 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:40.174628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1110/2247] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:57:40.179121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:40.190768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f2c0-a038-4de7-8510-915d810dbd1e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:40.196416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:40.197259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.197613 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.197997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] PATH_INFO: `/v3/projects/e192126ae309447294f58b8d2bb59b0a/users/1707177163b443bb85926ac7004383a6/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.217518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e192126ae309447294f58b8d2bb59b0a, user_id=1707177163b443bb85926ac7004383a6, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:40.220895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:40.237386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1138/2248] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:57:40 2022] PUT /identity/v3/projects/e192126ae309447294f58b8d2bb59b0a/users/1707177163b443bb85926ac7004383a6/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:40.247938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.248223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.248516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.279731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] MFA Rules not processed for user `1707177163b443bb85926ac7004383a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:40.280951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:40.313084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:40.353558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1111/2249] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:40.365771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:40.367447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:40.423674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45873e63-3162-4690-8c89-91afe7da5728 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:40.427341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:40.427957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:40.428240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:40.428515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:40.437289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:40.438760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa15e-8ab6-4db3-8141-e6fee825aaca service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:40.449786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1139/2250] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:57:50.350729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=14 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:50.445073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:56.991942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:56.993484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.031190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:57.031704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:57.031787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:57.069737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:57.071438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.154117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df28c-fb56-48fc-8e71-3514500d8200 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:57.161642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:57.162462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:57.162837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:57.163117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] PATH_INFO: `/v3/users/9fe4eae6128a4aec9f66e5fc6975c786` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:57.164362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe4eae6128a4aec9f66e5fc6975c786)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:57.166629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:57.172664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1140/2251] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:57.234499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:57.236345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.249183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe4eae6128a4aec9f66e5fc6975c786'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:57.250294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe4eae6128a4aec9f66e5fc6975c786'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:57.259940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe4eae6128a4aec9f66e5fc6975c786'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:57.260490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe4eae6128a4aec9f66e5fc6975c786'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:57.276418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-751cf519-425c-4512-b915-1e772f7887fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe4eae6128a4aec9f66e5fc6975c786'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:57.294317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1112/2252] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:56 2022] DELETE /identity/v3/users/9fe4eae6128a4aec9f66e5fc6975c786 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:57.298116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:57.298382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:57.298689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:57.318240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:57.319548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.334696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6bbf6-12c3-4a09-86ec-5222b29196d8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:57.402461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1113/2253] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:57.412601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:57.414128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.433885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:57.434511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:57.434800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:57.435072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:57.436990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:57.437802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:57.489219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd190-3ff9-4f4a-b78c-2c59797bde67 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:57.493633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:57.494310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:57.494626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:57.494920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:57.507630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:57.509125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:57.513304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:57.522432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1114/2254] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:57:57.525652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:57.527603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:57.537857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1141/2255] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 06:57:57.971954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:57.973449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:58.004531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1cfc-07ea-4729-b390-7781605d6496 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:58.014970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:58.016115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:58.022657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:58.022988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] PATH_INFO: `/v3/projects/c19dd388649d49cb8cac767637aa73b0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:58.024453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19dd388649d49cb8cac767637aa73b0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:58.026657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:58.148183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19dd388649d49cb8cac767637aa73b0', 'request_id': 'req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.170856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19dd388649d49cb8cac767637aa73b0', 'request_id': 'req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.186630 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19dd388649d49cb8cac767637aa73b0', 'request_id': 'req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.203138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] The token cache is being invalidate because project c19dd388649d49cb8cac767637aa73b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:58.203457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.208527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.211672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1115/2256] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:57 2022] DELETE /identity/v3/projects/c19dd388649d49cb8cac767637aa73b0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:58.215771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:58.247671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed40641-c2da-43b0-ac36-cb608cdc8834 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:58.457637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:58.457887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:58.457990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:58.458251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] PATH_INFO: `/v3/users/ab0d43d025c244a28bbdf709f82c5d81` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:58.462766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0d43d025c244a28bbdf709f82c5d81)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:58.469600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:58.565824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0d43d025c244a28bbdf709f82c5d81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.568673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0d43d025c244a28bbdf709f82c5d81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.569513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0d43d025c244a28bbdf709f82c5d81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.594147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0d43d025c244a28bbdf709f82c5d81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.629183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3f9671bf-b6df-46f4-93aa-6edddebcf431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0d43d025c244a28bbdf709f82c5d81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:58.668517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1142/2257] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:58 2022] DELETE /identity/v3/users/ab0d43d025c244a28bbdf709f82c5d81 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:57:59.264314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:59.266102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:59.289836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c8729-050b-4b3e-8be2-9f5c750ad7f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:59.436417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:59.437140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:59.437423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:59.437698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] PATH_INFO: `/v3/projects/6bc9c4f941f64171984d69201a7bae58` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:59.440361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc9c4f941f64171984d69201a7bae58)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:59.442572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:59.536615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:57:59.540123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc9c4f941f64171984d69201a7bae58', 'request_id': 'req-90bbf599-1995-4bfc-be6b-5d28e8699d6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:59.549906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc9c4f941f64171984d69201a7bae58', 'request_id': 'req-90bbf599-1995-4bfc-be6b-5d28e8699d6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:59.557182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc9c4f941f64171984d69201a7bae58', 'request_id': 'req-90bbf599-1995-4bfc-be6b-5d28e8699d6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:59.578260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] The token cache is being invalidate because project 6bc9c4f941f64171984d69201a7bae58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:57:59.578260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:59.578260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:57:59.584202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1116/2258] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:57:59 2022] DELETE /identity/v3/projects/6bc9c4f941f64171984d69201a7bae58 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:57:59.585839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc61-f5d0-4401-9537-c4e74dfc6421 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:59.586668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc61-f5d0-4401-9537-c4e74dfc6421 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:59.587101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc61-f5d0-4401-9537-c4e74dfc6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:59.613860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5456fc61-f5d0-4401-9537-c4e74dfc6421 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:59.615336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5456fc61-f5d0-4401-9537-c4e74dfc6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:59.636472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:59.640152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:59.784673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1143/2259] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:57:59.792304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:59.792845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:59.793315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:59.805744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf599-1995-4bfc-be6b-5d28e8699d6d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:57:59.821105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:57:59.822345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:57:59.823378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:57:59.825028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] PATH_INFO: `/v3/users/e3d636ee1144420093d5b6eac0fecc71` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:57:59.831113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d636ee1144420093d5b6eac0fecc71)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:57:59.836849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:57:59.894576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:57:59.899359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:57:59.949125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1144/2260] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:57:59.950120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:57:59.989336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:00.020895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b993-a6b2-413b-b22c-6df5fa9fcead None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.030278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.032798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.033573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.034478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.035444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:00.035817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.037588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.041940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d636ee1144420093d5b6eac0fecc71'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:00.053612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1145/2261] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:00.057429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.057763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d636ee1144420093d5b6eac0fecc71'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:00.062194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:00.084492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d636ee1144420093d5b6eac0fecc71'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:00.085915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d636ee1144420093d5b6eac0fecc71'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:00.098969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90a94-bc7b-4403-ab24-3f21d9c0bab3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.113658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c5008ca8-0f93-4691-8ec8-a9d611ebb348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d636ee1144420093d5b6eac0fecc71'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:00.115488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.116124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.116400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.116668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.120738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.123949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.142013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1117/2262] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:57:59 2022] DELETE /identity/v3/users/e3d636ee1144420093d5b6eac0fecc71 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:00.146665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.147292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.148159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.166021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1146/2263] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:00 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:00.169026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.192234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:00.194037 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:00.271257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cb0e8-fa32-4286-8bd4-97479533936c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.281177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.282012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.282339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.282837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.283677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.285680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.288597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:00.308826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1118/2264] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:00.310403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1147/2265] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:00 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:00.322884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.326122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.328075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:00.341157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ae0b-a4f2-4cd4-8bf0-2782765cba21 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.441047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.441047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.441047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.441047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.441718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.441718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.463448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1119/2266] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:00.467555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.482701 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0affd-b5f7-4800-9836-3e16c614f6ff admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.505213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.506221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.506507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.506776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.507481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.510474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8f02-ab66-4d5a-b0e7-71715f8c4a6c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.510645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.514217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.514951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.516292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.516292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.523885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1120/2267] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:00.528800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.529456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.531557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffe097-94f1-49ea-a84b-f31448705af0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.546067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1148/2268] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:00.548174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381943-93b3-4402-a856-a59b1ccd3bd2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.557549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.558468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.558749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.559335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] PATH_INFO: `/v3/projects/387d775ad91942f8a81b69ab28737c17/users/f9760575191b4fc1a037bb367e955486/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.576803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387d775ad91942f8a81b69ab28737c17, user_id=f9760575191b4fc1a037bb367e955486, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.580416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:00.600891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1121/2269] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:00 2022] PUT /identity/v3/projects/387d775ad91942f8a81b69ab28737c17/users/f9760575191b4fc1a037bb367e955486/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:00.614835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.615478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.615592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.687119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] MFA Rules not processed for user `f9760575191b4fc1a037bb367e955486`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:00.691161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:00.800667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:00.841643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1149/2270] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:00.847773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:00.957065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae793fa3-990e-401e-8249-5df906fff410 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:00.962958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:00.963693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:00.964073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:00.964478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:00.965475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:00.968336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.026354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1122/2271] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:01.029528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.047513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfedf3d-793b-4cd6-882f-cd8be63579b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.170352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.172409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.172409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.172607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.173359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.178281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.220174 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1150/2272] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:01 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:01.224102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.243508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a33a1-ccdb-4c64-ab08-5615d332a4f0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.250486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.252268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.253514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.253969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.255118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.258588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.289905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1123/2273] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:01.292685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.317607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d859-5684-474b-8081-75cf992505c9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.331680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.332406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.332700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.333032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] PATH_INFO: `/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93/users/d5b7409ef11c4cb383a983bbb58975e3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.404461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffba02c5e634d20ac7fbae94cbbab93, user_id=d5b7409ef11c4cb383a983bbb58975e3, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.414071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.488751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1151/2274] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:01 2022] PUT /identity/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93/users/d5b7409ef11c4cb383a983bbb58975e3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:01.500515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.519046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.522537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:01.539794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e531213-80c7-4c44-976b-94730ca1766c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.650030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.650623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.650915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.651195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.651896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.655700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.659271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3e680-78f3-40de-84e3-f1acce9fef61 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.665577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.666230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.666510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.666787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] PATH_INFO: `/v3/projects/c3750af3c19e4952853b35204991dcb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.667945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3750af3c19e4952853b35204991dcb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.669027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1124/2275] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:01.669899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.673460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.685013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b30dd-fcaf-4590-93d7-15316cbc57e1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.695402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.696015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.696304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.696587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] PATH_INFO: `/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93/users/d5b7409ef11c4cb383a983bbb58975e3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.698642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffba02c5e634d20ac7fbae94cbbab93, user_id=d5b7409ef11c4cb383a983bbb58975e3, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.701334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00e548-faf0-4e60-8ab6-d7796c2db839 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.714209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1125/2276] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:01 2022] PUT /identity/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93/users/d5b7409ef11c4cb383a983bbb58975e3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:01.728803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.729136 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.729538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.742458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3750af3c19e4952853b35204991dcb6', 'request_id': 'req-7ea03014-42c1-474e-a4bb-4414ccdd3792'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:01.747420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:01.755267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:01.757230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3750af3c19e4952853b35204991dcb6', 'request_id': 'req-7ea03014-42c1-474e-a4bb-4414ccdd3792'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:01.769651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3750af3c19e4952853b35204991dcb6', 'request_id': 'req-7ea03014-42c1-474e-a4bb-4414ccdd3792'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:01.775826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] MFA Rules not processed for user `d5b7409ef11c4cb383a983bbb58975e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:01.777402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:01.799444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] The token cache is being invalidate because project c3750af3c19e4952853b35204991dcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:01.799782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:01.800443 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7ea03014-42c1-474e-a4bb-4414ccdd3792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:01.809257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1152/2277] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:01 2022] DELETE /identity/v3/projects/c3750af3c19e4952853b35204991dcb6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:01.814299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caad0d-23f7-4be1-9293-e1625e526ae1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.814824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caad0d-23f7-4be1-9293-e1625e526ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.815010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caad0d-23f7-4be1-9293-e1625e526ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.847671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d1caad0d-23f7-4be1-9293-e1625e526ae1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:01.847671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d1caad0d-23f7-4be1-9293-e1625e526ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:01.889128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1126/2278] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:01.902043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.903484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:01.929124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1153/2279] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:01.933349 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.933856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.934341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.957320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:01.958584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:01.969039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1154/2280] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:01.972087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:01.977581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fee78-15e7-46f1-a4cd-3d718723af5c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.982785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.983421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.983702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.983978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.984644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e856bc-e1b6-4c6d-8083-6597153c54a8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:01.990447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:01.991152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:01.991513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:01.991879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:01.992654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:01.993087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.994773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:01.995247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:01.996692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.008133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1127/2281] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:02.011923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1155/2282] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 06:58:02.022006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.043854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.046003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.047740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718312-de55-40c0-9567-01407dcdfb59 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.053134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.053878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.054232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.055006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.055748 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.059357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.073407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea61f-541e-4577-b627-3d559240c6cc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.083893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.085114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.085604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.086779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] PATH_INFO: `/v3/users/f9760575191b4fc1a037bb367e955486` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.088414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9760575191b4fc1a037bb367e955486)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.090684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.105418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1128/2283] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:02 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:02.108779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.208608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9760575191b4fc1a037bb367e955486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:02.209370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9760575191b4fc1a037bb367e955486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:02.210022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9760575191b4fc1a037bb367e955486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:02.213533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218e2a-80d2-422c-9092-2268bd5a7037 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.218792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9760575191b4fc1a037bb367e955486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:02.221118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.221967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.222412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.222849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.224089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.226523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.234637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3cbdb2f0-4e99-4428-ac9c-294ef9773258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9760575191b4fc1a037bb367e955486'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:02.251638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1156/2284] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:02 2022] DELETE /identity/v3/users/f9760575191b4fc1a037bb367e955486 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:02.254278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1129/2285] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:02 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:02.259280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3326b-e177-412c-a747-82ed1de918af None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.259598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3326b-e177-412c-a747-82ed1de918af None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.259879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3326b-e177-412c-a747-82ed1de918af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.263540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.265790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.275662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:02.284095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-79a3326b-e177-412c-a747-82ed1de918af None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:02.285526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38d00c-33a1-4e5e-b7c4-abaa01325bbc admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.286039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-79a3326b-e177-412c-a747-82ed1de918af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.349593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:02.384266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.385722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.386225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.386806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.387513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.388150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1157/2286] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:02.389459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.401283 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3326b-e177-412c-a747-82ed1de918af None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.405072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1130/2287] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:02.406274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-79a3326b-e177-412c-a747-82ed1de918af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.409132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.425634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1d65-088f-4cb9-b307-16c4326fa2e6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.431517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.432077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.432355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.432632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.433532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.435788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.453106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1131/2288] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:02.459611 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.477227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0835c-6b65-4323-a7bd-93b89cd09042 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.483639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.484320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.484599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.484871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] PATH_INFO: `/v3/projects/80586290a914480b93e8e515bb625fde/users/54c7cbdae7b345f984d5d26ae614a45e/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.518061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80586290a914480b93e8e515bb625fde, user_id=54c7cbdae7b345f984d5d26ae614a45e, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.523134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ea9ad-dcab-449c-9084-220ccb38b72e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.528890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3326b-e177-412c-a747-82ed1de918af None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.535825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.536815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.537355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.537540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.556792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.556792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:02.557501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1132/2289] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:02 2022] PUT /identity/v3/projects/80586290a914480b93e8e515bb625fde/users/54c7cbdae7b345f984d5d26ae614a45e/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:02.559335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.559780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.560244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.569010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1158/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:02.620080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] MFA Rules not processed for user `54c7cbdae7b345f984d5d26ae614a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:02.621393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.769276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1133/2291] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:02.781638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.783848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.871650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88c02-d0b0-4b1a-afcf-1f92273bcfc8 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:02.968997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:02.971679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:02.972056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:02.972888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:02.973371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:02.973902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:02.988040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:02.990575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.030462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1159/2292] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:03.068884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:03.081479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:03.102991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231122f-f6ef-42a0-9fb4-2ed9768a4067 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:03.116736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:03.117938 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.118589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.119075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] PATH_INFO: `/v3/projects/387d775ad91942f8a81b69ab28737c17` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.120422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387d775ad91942f8a81b69ab28737c17)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:03.123636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.137465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:03.170585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfa59-dfa2-47b9-90fd-f8fce925ebe6 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:03.193885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387d775ad91942f8a81b69ab28737c17', 'request_id': 'req-37d15a19-6899-4ccc-bf05-618bb9cfb598'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.202035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387d775ad91942f8a81b69ab28737c17', 'request_id': 'req-37d15a19-6899-4ccc-bf05-618bb9cfb598'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.208551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387d775ad91942f8a81b69ab28737c17', 'request_id': 'req-37d15a19-6899-4ccc-bf05-618bb9cfb598'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.228907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] The token cache is being invalidate because project 387d775ad91942f8a81b69ab28737c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:03.229427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.230317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.233077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1134/2293] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:02 2022] DELETE /identity/v3/projects/387d775ad91942f8a81b69ab28737c17 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:03.237375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:03.240706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:03.244899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:03.245807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.245981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.246254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] PATH_INFO: `/v3/users/54c7cbdae7b345f984d5d26ae614a45e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.247481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c7cbdae7b345f984d5d26ae614a45e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:03.265798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.281474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15a19-6899-4ccc-bf05-618bb9cfb598 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:03.290012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:03.290785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.291174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.291563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] PATH_INFO: `/v3/users/d5b7409ef11c4cb383a983bbb58975e3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.293812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b7409ef11c4cb383a983bbb58975e3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:03.296795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.363020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c7cbdae7b345f984d5d26ae614a45e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.363784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c7cbdae7b345f984d5d26ae614a45e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.364415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c7cbdae7b345f984d5d26ae614a45e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.375537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b7409ef11c4cb383a983bbb58975e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.376378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b7409ef11c4cb383a983bbb58975e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.380921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c7cbdae7b345f984d5d26ae614a45e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.395718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b7409ef11c4cb383a983bbb58975e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.397070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b7409ef11c4cb383a983bbb58975e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.399873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-00d3f963-ecc5-4a85-8c10-b503342316a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c7cbdae7b345f984d5d26ae614a45e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.419898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1160/2294] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:03 2022] DELETE /identity/v3/users/54c7cbdae7b345f984d5d26ae614a45e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:03.424723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b7409ef11c4cb383a983bbb58975e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:03.425992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.426287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.426570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.449146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1135/2295] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:03 2022] DELETE /identity/v3/users/d5b7409ef11c4cb383a983bbb58975e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:03.459506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:03.461547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:03.570872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1161/2296] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:03.585381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:03.588417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:03.683867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcca22-ac4f-4855-9be0-d8fa1e7afd0d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:03.689679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:03.690315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.690880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.690880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.702746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:03.706334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed975e7-7cf6-4f77-90b5-bf60272fbec8 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.711988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:03.722113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1136/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:03.926004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:03.927758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:03.954628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7306b-283b-4a44-a179-0b231a1070e7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:03.983284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:03.983943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:03.984246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:03.984522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] PATH_INFO: `/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:03.986203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffba02c5e634d20ac7fbae94cbbab93)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:03.988151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:03.991084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:04.074130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffba02c5e634d20ac7fbae94cbbab93', 'request_id': 'req-e4c949e2-07ab-4933-a43c-5f8f39a13c49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.084925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffba02c5e634d20ac7fbae94cbbab93', 'request_id': 'req-e4c949e2-07ab-4933-a43c-5f8f39a13c49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.098091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffba02c5e634d20ac7fbae94cbbab93', 'request_id': 'req-e4c949e2-07ab-4933-a43c-5f8f39a13c49'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.126226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] The token cache is being invalidate because project 6ffba02c5e634d20ac7fbae94cbbab93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:04.126504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.127170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.129062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1162/2298] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:03 2022] DELETE /identity/v3/projects/6ffba02c5e634d20ac7fbae94cbbab93 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:04.134359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e364-89aa-4bdf-b991-7e56f653d164 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.134528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.134683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e364-89aa-4bdf-b991-7e56f653d164 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.134919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e364-89aa-4bdf-b991-7e56f653d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.136021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.163552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9209e364-89aa-4bdf-b991-7e56f653d164 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:04.165101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9209e364-89aa-4bdf-b991-7e56f653d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.245896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1137/2299] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:04.254815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.255158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.255552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.262442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949e2-07ab-4933-a43c-5f8f39a13c49 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.269449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.270106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.270393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.270671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] PATH_INFO: `/v3/projects/80586290a914480b93e8e515bb625fde` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.271918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80586290a914480b93e8e515bb625fde)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.274160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.285197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:04.286609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.306447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1138/2300] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:04.315225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.325225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82cb45-eb9c-40d2-9ec4-c635c2f0b38c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.333504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.334318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.334624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.334934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.335749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:04.336051 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.338248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.356523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1139/2301] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:04.361429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.372577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774136-20cc-4a6f-a757-f8569ac438be admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.390774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80586290a914480b93e8e515bb625fde', 'request_id': 'req-037f593a-84c9-4171-9d32-e83cf6216f39'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.397975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80586290a914480b93e8e515bb625fde', 'request_id': 'req-037f593a-84c9-4171-9d32-e83cf6216f39'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.409397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80586290a914480b93e8e515bb625fde', 'request_id': 'req-037f593a-84c9-4171-9d32-e83cf6216f39'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.452501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] The token cache is being invalidate because project 80586290a914480b93e8e515bb625fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:04.454226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.456834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-037f593a-84c9-4171-9d32-e83cf6216f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:04.462271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1163/2302] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:04 2022] DELETE /identity/v3/projects/80586290a914480b93e8e515bb625fde => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:04.467007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca165-0204-42c2-9631-b3ee0fcf8a60 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.467363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca165-0204-42c2-9631-b3ee0fcf8a60 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.467711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca165-0204-42c2-9631-b3ee0fcf8a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.472935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.474879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.475446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.475986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.477268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.479668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.497496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e2fca165-0204-42c2-9631-b3ee0fcf8a60 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:04.499238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e2fca165-0204-42c2-9631-b3ee0fcf8a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.523942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1140/2303] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:04.524924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.527157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1164/2304] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:04.527590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.528577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.528860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.529162 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.559551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:04.560811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:04.576547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:04.650563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ebe-bdd0-4f37-9d34-726529666288 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.660736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.662070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.662346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.662744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.664299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.668724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.689001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:04.710957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1165/2305] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:04.715315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.721118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1141/2306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:04.739513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.745321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668eed3-4cf2-42f2-8399-1f505220415e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.760264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.773521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.796801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9787-8b1e-4815-b6bc-9aa6266d17cb admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.811778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.815057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1166/2307] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:04.815823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.816329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.816820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.818880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.819078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.824698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.835486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b76b60-588a-46e5-9392-42c0bf472a54 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.843839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:04.845540 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:04.846106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:04.847117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:04.847117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:04.849611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:04.864800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1142/2308] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:04.868128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:04.910825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1167/2309] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:04.914362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6641d-1f30-40c6-a990-25d47c7f61f4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:04.920458 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.073225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.073225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.073225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.073225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.073586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.073586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.085134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6af6ff-d87b-4d2f-ac1b-309bff5116a3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.097172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1143/2310] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:05.106061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.106834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.107674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.108511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.108918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.111328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.118994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.123324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120fd92-c8fc-4b80-bc34-bc58cfb4f6a8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.131040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.131923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.132359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.132802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] PATH_INFO: `/v3/projects/8e3278da7a0f402f97b8e8718b2bc2e8/users/8dec906bb11e413db885d39c57e6d7b6/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.161204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3278da7a0f402f97b8e8718b2bc2e8, user_id=8dec906bb11e413db885d39c57e6d7b6, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.165300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8953d2-b990-40c5-b281-a38a049d9c82 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.169360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1168/2311] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:04 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:05.171634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.193777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55b7-3646-4342-9bf7-12fa0537bea4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.209523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1144/2312] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:05 2022] PUT /identity/v3/projects/8e3278da7a0f402f97b8e8718b2bc2e8/users/8dec906bb11e413db885d39c57e6d7b6/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:05.211486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.211815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.212165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.263116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] MFA Rules not processed for user `8dec906bb11e413db885d39c57e6d7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:05.264279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:05.308102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.308741 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.309138 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.309585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.310292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.312098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.325026 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1169/2313] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:58:05.327674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.337617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:05.345297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efc29-52eb-4e37-b116-f7b6c04c2f81 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.356588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.357654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.358021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.358310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.359000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.361208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.379246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1145/2314] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:05.379480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1170/2315] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:58:05.380440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.380591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.392018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250eb-ba1f-4ff3-9243-31ced112ee7f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.392389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96745d22-6d78-4fb3-a58b-92a586a9bb37 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.397346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.397752 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.398333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.398692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.398945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.399157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.399545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] PATH_INFO: `/v3/projects/7136379aa8fa42daa8128b7fe419bea1/users/5fc045c3d983460d98925fb56eaed481/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.399660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.400730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.403583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.419708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7136379aa8fa42daa8128b7fe419bea1, user_id=5fc045c3d983460d98925fb56eaed481, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.425691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78301c61-6693-44ba-a200-a99a1c52c70b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.436939 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1171/2316] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:05 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:05.441913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.456354 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1146/2317] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:05 2022] PUT /identity/v3/projects/7136379aa8fa42daa8128b7fe419bea1/users/5fc045c3d983460d98925fb56eaed481/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:05.458255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.458255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.458514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.487100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] MFA Rules not processed for user `5fc045c3d983460d98925fb56eaed481`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:05.488302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:05.498787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:05.554707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca29455-fc83-41ff-b7f8-4bbc676e2ca7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.581832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1147/2318] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:05.596137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.596137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:05.649294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.650964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.651352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.651732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.652545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.654886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.665769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23193249-a9a3-47a7-8891-88ec5ab95d2b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.671843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.671843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.671843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.672331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.690421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.692391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.693924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1172/2319] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:05 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:05.694936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.707127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869707c5-cca2-4a14-8dba-58fe90b97d19 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.713598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1148/2320] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:05.718838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.720686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.721219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.721596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.722411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.724396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.737593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1173/2321] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:05.741944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.757154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8486-f27c-4eea-b846-9a669834f08d service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.763571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.764644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.764927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.765230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] PATH_INFO: `/v3/projects/1df9a535ee61482da1ef56aa4c33a561/users/24c44482b6f2432cbacd149af7b2b99c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.793870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df9a535ee61482da1ef56aa4c33a561, user_id=24c44482b6f2432cbacd149af7b2b99c, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.799698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:05.825540 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1149/2322] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:05 2022] PUT /identity/v3/projects/1df9a535ee61482da1ef56aa4c33a561/users/24c44482b6f2432cbacd149af7b2b99c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:05.826925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:05.847328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d39362-5f10-4068-b9ac-91ae33d07ee1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:05.977262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:05.990086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:05.991596 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:05.991885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:05.992173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:05.992878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:05.995074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f3a97-c6b0-427d-ac66-03e8c0e48596 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:06.015106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1174/2323] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:06.020117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:06.034152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4687-5a9e-41ac-8092-cd4f67811396 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:06.042993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:06.043574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:06.043863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:06.044409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] PATH_INFO: `/v3/projects/1df9a535ee61482da1ef56aa4c33a561/users/24c44482b6f2432cbacd149af7b2b99c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:06.047384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df9a535ee61482da1ef56aa4c33a561, user_id=24c44482b6f2432cbacd149af7b2b99c, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:06.054946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:06.081017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1150/2324] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:06 2022] PUT /identity/v3/projects/1df9a535ee61482da1ef56aa4c33a561/users/24c44482b6f2432cbacd149af7b2b99c/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:06.082901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:06.083245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:06.083660 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:06.133554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] MFA Rules not processed for user `24c44482b6f2432cbacd149af7b2b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:06.135023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:06.268400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1175/2325] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:06.428905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:06.592383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd4b-1abd-4d1b-8978-e476abfdcf7a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:06.599955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:06.605034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:06.605034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:06.605272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:06.633845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:06.635733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:06.651482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1151/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:07.140922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:07.154982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe37f-049b-4423-851c-56e7fa53485d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:07.160088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c44482b6f2432cbacd149af7b2b99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df9a535ee61482da1ef56aa4c33a561', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:07.160665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:07.161021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:07.161274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:07.161979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:07.162284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:07.168564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:07.185804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1176/2327] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:07.187239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:07.201990 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eee2-f9a7-488e-bfb8-3eb131622c20 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:07.208828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c44482b6f2432cbacd149af7b2b99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df9a535ee61482da1ef56aa4c33a561', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:07.209550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:07.209891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:07.210232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:07.211009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:07.213299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:07.231595 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:07.251977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1152/2328] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:07 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:07.256312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:07.266120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cc81e-c617-4560-b750-c90e39152ae5 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:07.325206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c44482b6f2432cbacd149af7b2b99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df9a535ee61482da1ef56aa4c33a561', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:07.325836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:07.326123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:07.326402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:07.327097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:07.327410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:07.329604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:07.346098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1177/2329] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:07.387913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:07.399183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d6f76-68f6-4967-9354-95fc65800dfc tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:07.403899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c44482b6f2432cbacd149af7b2b99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df9a535ee61482da1ef56aa4c33a561', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:07.404548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:07.404831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:07.405153 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] PATH_INFO: `/v3/projects/cb3ed8ab68634a33929f1a6447cbde71` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:07.406305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb3ed8ab68634a33929f1a6447cbde71)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:07.408390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:07.468709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3ed8ab68634a33929f1a6447cbde71', 'request_id': 'req-64bbc74c-6cca-4df2-bc45-c0c0255ce983'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:07.475031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3ed8ab68634a33929f1a6447cbde71', 'request_id': 'req-64bbc74c-6cca-4df2-bc45-c0c0255ce983'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:07.482356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3ed8ab68634a33929f1a6447cbde71', 'request_id': 'req-64bbc74c-6cca-4df2-bc45-c0c0255ce983'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:07.497792 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] The token cache is being invalidate because project cb3ed8ab68634a33929f1a6447cbde71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:07.498168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:07.499077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64bbc74c-6cca-4df2-bc45-c0c0255ce983 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:07.501457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1153/2330] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:07 2022] DELETE /identity/v3/projects/cb3ed8ab68634a33929f1a6447cbde71 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:08.019879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:08.021813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:08.159264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ea9-fe36-451b-ae44-ad78567c4116 tempest-VolumeQuotaClassesTest-501963545 tempest-VolumeQuotaClassesTest-501963545-project-admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:08.163436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:08.240499 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:08.241199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:08.241480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:08.241756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] PATH_INFO: `/v3/users/8dec906bb11e413db885d39c57e6d7b6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:08.242942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dec906bb11e413db885d39c57e6d7b6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:08.244910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:08.321044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dec906bb11e413db885d39c57e6d7b6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:08.322028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dec906bb11e413db885d39c57e6d7b6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:08.322824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dec906bb11e413db885d39c57e6d7b6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:08.331619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dec906bb11e413db885d39c57e6d7b6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:08.346870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dec906bb11e413db885d39c57e6d7b6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:08.364724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1178/2331] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:08 2022] DELETE /identity/v3/users/8dec906bb11e413db885d39c57e6d7b6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:08.369681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:08.370222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:08.370325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:08.392618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:08.393923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:08.480279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1154/2332] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:08.487756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:08.489583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:08.571263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5dc4-41f8-4708-9e4b-e15c71378ab1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:08.579826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:08.580529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:08.581000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:08.581297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:08.595922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:08.597841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20662-0f22-4da7-9c76-3c3f5a8eaa3d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:08.634701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1179/2333] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:08.907781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:08.907781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:08.919529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915be56-1d18-4ad3-b513-828a98f1281f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:08.925294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:08.925940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:08.926469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:08.926964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] PATH_INFO: `/v3/users/ccd098b984864ff3a6348b04931711c5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:08.931228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd098b984864ff3a6348b04931711c5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:08.937828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:09.036598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd098b984864ff3a6348b04931711c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.038858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd098b984864ff3a6348b04931711c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.057310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd098b984864ff3a6348b04931711c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.059966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd098b984864ff3a6348b04931711c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.082923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd098b984864ff3a6348b04931711c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.085239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:09.104495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1155/2334] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:08 2022] DELETE /identity/v3/users/ccd098b984864ff3a6348b04931711c5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:09.109009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:09.109657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:09.110339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:09.139097 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:09.140431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:09.183565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:09.228925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1180/2335] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:09.263835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:09.265030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:09.338109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:09.339891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:09.358912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919f687-7c6c-431c-9265-bf5a89060de9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:09.370528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:09.374214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:09.374907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:09.375343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] PATH_INFO: `/v3/projects/8e3278da7a0f402f97b8e8718b2bc2e8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:09.379202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3278da7a0f402f97b8e8718b2bc2e8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:09.383337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba409-5e95-4b5d-9b87-ddc308cbe011 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:09.392809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:09.393677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:09.394537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:09.394915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:09.395372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:09.415142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:09.416787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:09.435260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1156/2336] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:09.470325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3278da7a0f402f97b8e8718b2bc2e8', 'request_id': 'req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.477496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3278da7a0f402f97b8e8718b2bc2e8', 'request_id': 'req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.491683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3278da7a0f402f97b8e8718b2bc2e8', 'request_id': 'req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.525432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] The token cache is being invalidate because project 8e3278da7a0f402f97b8e8718b2bc2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:09.526200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.526997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.528861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1181/2337] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:09 2022] DELETE /identity/v3/projects/8e3278da7a0f402f97b8e8718b2bc2e8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:09.533239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:09.545304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7772-db15-4373-91ca-26cf79b25d78 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:09.634429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:09.635206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:09.635559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:09.635891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] PATH_INFO: `/v3/users/24c44482b6f2432cbacd149af7b2b99c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:09.637259 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c44482b6f2432cbacd149af7b2b99c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:09.640303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:09.722870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c44482b6f2432cbacd149af7b2b99c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.723811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c44482b6f2432cbacd149af7b2b99c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.739223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c44482b6f2432cbacd149af7b2b99c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.740212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c44482b6f2432cbacd149af7b2b99c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.761584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c44482b6f2432cbacd149af7b2b99c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:09.782964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1157/2338] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:09 2022] DELETE /identity/v3/users/24c44482b6f2432cbacd149af7b2b99c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:10.410937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:10.412482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:10.434239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcb74a-b33d-4d2b-907f-66dbe6e430c6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:10.439083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:10.440728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:10.484414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:10.510220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:10.511080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:10.511475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:10.511853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] PATH_INFO: `/v3/projects/1df9a535ee61482da1ef56aa4c33a561` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:10.513434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df9a535ee61482da1ef56aa4c33a561)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:10.515764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:10.584118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df9a535ee61482da1ef56aa4c33a561', 'request_id': 'req-ee9039c8-10a3-40d0-b208-9a093c24293d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.595929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:10.601426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df9a535ee61482da1ef56aa4c33a561', 'request_id': 'req-ee9039c8-10a3-40d0-b208-9a093c24293d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.607098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e0c39-3e53-4069-968e-b728777d20a1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:10.633071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df9a535ee61482da1ef56aa4c33a561', 'request_id': 'req-ee9039c8-10a3-40d0-b208-9a093c24293d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.666435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] The token cache is being invalidate because project 1df9a535ee61482da1ef56aa4c33a561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:10.668200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.669341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9039c8-10a3-40d0-b208-9a093c24293d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.674227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1182/2339] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:10 2022] DELETE /identity/v3/projects/1df9a535ee61482da1ef56aa4c33a561 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:10.681763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791ad0-fc53-42db-ae39-e8716b994393 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:10.683725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791ad0-fc53-42db-ae39-e8716b994393 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:10.684492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a791ad0-fc53-42db-ae39-e8716b994393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:10.733239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5a791ad0-fc53-42db-ae39-e8716b994393 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:10.735725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5a791ad0-fc53-42db-ae39-e8716b994393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:10.761984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:10.762848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:10.763689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:10.763971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] PATH_INFO: `/v3/projects/b061506a37754860b77ad1a3a39fbbb9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:10.765697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b061506a37754860b77ad1a3a39fbbb9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:10.770800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:10.858605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1183/2340] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:10.876737 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:10.878610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:10.879074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:10.912567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b061506a37754860b77ad1a3a39fbbb9', 'request_id': 'req-280f395f-bfcd-4141-95fb-ba3a292e878d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.923030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b061506a37754860b77ad1a3a39fbbb9', 'request_id': 'req-280f395f-bfcd-4141-95fb-ba3a292e878d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.932718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b061506a37754860b77ad1a3a39fbbb9', 'request_id': 'req-280f395f-bfcd-4141-95fb-ba3a292e878d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.954879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:10.958749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:10.961137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] The token cache is being invalidate because project b061506a37754860b77ad1a3a39fbbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:10.961928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.963132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:10.981221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1158/2341] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:10 2022] DELETE /identity/v3/projects/b061506a37754860b77ad1a3a39fbbb9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:11.151665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1184/2342] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:11.157728 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.174971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f395f-bfcd-4141-95fb-ba3a292e878d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.188164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.190214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.190906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.191607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.198832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:11.199368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.206123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.228638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1159/2343] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:11.234306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.245696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128237d-2c00-4067-8e48-2b220d08824d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.252593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.254074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.254457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.254833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.255810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.258022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.305017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1185/2344] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:11 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:11.309118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.326220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb359a9-779f-4c37-bff7-1385fa0fc051 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.450857 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:11.521546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.521546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.521546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.521546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.523186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.523186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.548423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1160/2345] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:11 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:11.573012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.588946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bcd3f-b087-4962-a5e8-7240cc8d8c4a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.593986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.594937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.595227 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.595692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.596510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.598235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.617027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1186/2346] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:11.620517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.631704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f3fb-6cd2-4cad-bad6-8a7a9e06120f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.636542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.637186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.637470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.637769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.638461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.640052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13acaa-1714-46ed-a5fc-5b96398d2fbb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.651583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1161/2347] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:11.655734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.670909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e0538-6b7a-4b0f-88cd-9ef420110774 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:11.692493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:11.693432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.693883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.694236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] PATH_INFO: `/v3/projects/0690b11796924a2facd59fb5bd51f50d/users/e74104bb1a514df589f602ace49ee0e3/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.715085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0690b11796924a2facd59fb5bd51f50d, user_id=e74104bb1a514df589f602ace49ee0e3, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:11.715858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:11.732467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1187/2348] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:11 2022] PUT /identity/v3/projects/0690b11796924a2facd59fb5bd51f50d/users/e74104bb1a514df589f602ace49ee0e3/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:11.742518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:11.742870 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:11.743089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:11.785732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] MFA Rules not processed for user `e74104bb1a514df589f602ace49ee0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:11.787268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:11.912746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1162/2349] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:11.917675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:11.951044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:11.994851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f3b9-06a6-428a-b81c-db536dc62579 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.003422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.004404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.005040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.005572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.006207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.008230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.046597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1188/2350] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:11 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:12.052706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.067344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d87fd-ee47-4048-8a21-a2956420f8f1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.171345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.172078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.172828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.173135 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.174102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.174557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.176241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:12.176993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.192633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506167ba-c892-4194-9b47-81ec2d776cbd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.199604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.200562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.201117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.202030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] PATH_INFO: `/v3/users/1707177163b443bb85926ac7004383a6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.204394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1707177163b443bb85926ac7004383a6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.207278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.228187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1163/2351] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:12 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:12.231189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.257539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db175-a3c3-449c-a55a-05cedf018f45 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.269599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.270416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.271995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.272352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.273301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.275386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.304392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1164/2352] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:12.321522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.343447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b73cc-3167-4b78-86dc-9710256da12b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.354684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.355416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.355636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.355914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] PATH_INFO: `/v3/projects/98f6f010707c466dafba024670a87d49/users/25b14de135974c2086b2e3500cde4d6d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.357114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1707177163b443bb85926ac7004383a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:12.357811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1707177163b443bb85926ac7004383a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:12.358527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1707177163b443bb85926ac7004383a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:12.377163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1707177163b443bb85926ac7004383a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:12.392999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f6f010707c466dafba024670a87d49, user_id=25b14de135974c2086b2e3500cde4d6d, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.396957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.401069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-65391950-8305-45f1-bf03-0a7ec45cf9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1707177163b443bb85926ac7004383a6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:12.421749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:12.429759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1189/2353] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:12 2022] DELETE /identity/v3/users/1707177163b443bb85926ac7004383a6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:12.436751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1165/2354] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:12 2022] PUT /identity/v3/projects/98f6f010707c466dafba024670a87d49/users/25b14de135974c2086b2e3500cde4d6d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:12.437494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.437770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.438697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.439049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.440292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:12.494051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:12.499830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:12.557977 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caea39-b2cf-4a15-ac1d-f5251402919e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.642983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1190/2355] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:12.645875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.648017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:12.714369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.715189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.715457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.715860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.716589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.717482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:12.718432 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.739520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1166/2356] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:12.740390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.754688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc448f-b5f0-464c-8d4d-c24295404a27 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.762485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.763266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.763715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.763994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] PATH_INFO: `/v3/projects/98f6f010707c466dafba024670a87d49/users/25b14de135974c2086b2e3500cde4d6d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.766024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a35bf-fa7d-42ce-8183-d05cb6feb846 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:12.767356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f6f010707c466dafba024670a87d49, user_id=25b14de135974c2086b2e3500cde4d6d, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.771271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdfd60-031b-4ceb-8e22-f6152476eda3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.772330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:12.773588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.774148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.774673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.784657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1167/2357] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:12 2022] PUT /identity/v3/projects/98f6f010707c466dafba024670a87d49/users/25b14de135974c2086b2e3500cde4d6d/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:12.787626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:12.789438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:12.796164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:12.796359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:12.796666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:12.805525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1191/2358] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:12.832954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] MFA Rules not processed for user `25b14de135974c2086b2e3500cde4d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:12.834216 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:12.941761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1168/2359] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:12.952756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:12.954627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.049194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115c444-62dc-42a8-b1f6-1fc14da3287e service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.122474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.123102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.123389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.123665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.133285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.134725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686d37-b579-4054-a885-0aec546b1608 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.144716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1192/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:13.202672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.204380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.230598 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:13.289746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be041208-6bbf-4551-98dd-433f7ac9c288 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.294351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.294997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.295283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.295559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] PATH_INFO: `/v3/projects/e192126ae309447294f58b8d2bb59b0a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.296716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e192126ae309447294f58b8d2bb59b0a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.298775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.353643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e192126ae309447294f58b8d2bb59b0a', 'request_id': 'req-bcf6a541-fed6-493d-906b-6ce666f4c566'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.359084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e192126ae309447294f58b8d2bb59b0a', 'request_id': 'req-bcf6a541-fed6-493d-906b-6ce666f4c566'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.365998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e192126ae309447294f58b8d2bb59b0a', 'request_id': 'req-bcf6a541-fed6-493d-906b-6ce666f4c566'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.379194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] The token cache is being invalidate because project e192126ae309447294f58b8d2bb59b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:13.379481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.380207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bcf6a541-fed6-493d-906b-6ce666f4c566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.381882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1169/2361] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:13 2022] DELETE /identity/v3/projects/e192126ae309447294f58b8d2bb59b0a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:13.386966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.387254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.387531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.409294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:13.410810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.486868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1193/2362] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:13.495199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.495495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.495798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.519896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:13.521298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.529720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1170/2363] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:13.535165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.548855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7de4f7-979f-429d-9b83-c1614f725053 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.554463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.555094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.555373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.555672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.556374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:13.556751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.558479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.584593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1194/2364] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:13.586547 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.598515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa86f9-f602-4895-bdf6-e573a3b25309 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.603489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.604105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.604387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.604661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.605351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.607269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.634558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1171/2365] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:13.638888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.651999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ef43e-51f4-4316-90eb-7c0cbd8b1fff admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.670636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:13.743060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.743700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.743998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.744273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.745230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.748633 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.779157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1195/2366] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:13.784542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.796068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540030-ae34-4689-b278-0c80b9db2269 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.807680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.808490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.808795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.809225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.810184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.812070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.824910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1172/2367] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:13.831176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.832724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.835269 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.841774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50137b7-d6d7-4275-999d-10f091fd02f1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.848869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.849645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.850020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.850323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.850999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.852247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38ae5-0fba-4fa5-9d9d-252c596472e7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.852595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.857830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.858566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.858914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.859261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] PATH_INFO: `/v3/users/e74104bb1a514df589f602ace49ee0e3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.861219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74104bb1a514df589f602ace49ee0e3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.863211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.865022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1196/2368] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:13.869649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:13.879699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c944c-cf07-4b4c-bed2-ffe21e04347f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:13.884524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:13.885233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.885521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.885804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] PATH_INFO: `/v3/projects/fcd28601c79a4153adffa2e7287db84c/users/9c35511501934834b75f91f4aa7cfe23/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.902432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd28601c79a4153adffa2e7287db84c, user_id=9c35511501934834b75f91f4aa7cfe23, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:13.905116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc924e-6b38-46fc-bf65-7fbca4e65407 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:13.912919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74104bb1a514df589f602ace49ee0e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.913625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74104bb1a514df589f602ace49ee0e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.918639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1197/2369] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:13 2022] PUT /identity/v3/projects/fcd28601c79a4153adffa2e7287db84c/users/9c35511501934834b75f91f4aa7cfe23/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:13.920908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74104bb1a514df589f602ace49ee0e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.927393 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74104bb1a514df589f602ace49ee0e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.929708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.929996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.930275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.932082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:13.942543 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-147982d9-45ee-4e5b-abb6-e692e23fe8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74104bb1a514df589f602ace49ee0e3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:13.956560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1173/2370] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:13 2022] DELETE /identity/v3/users/e74104bb1a514df589f602ace49ee0e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:13.960839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:13.961164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:13.961461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:13.962747 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] MFA Rules not processed for user `9c35511501934834b75f91f4aa7cfe23`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:13.963969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:13.981827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:13.983120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.032950 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1198/2371] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:14.037922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.039532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.050520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1174/2372] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:14.063558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.066851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.119844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:14.124468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407c5c-fd51-4c1d-a8ed-d657931c352f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.130913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.131756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.132065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.132333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.133021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.134952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.167160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d557cc-f347-4851-9bac-677fcf9a2d61 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.174725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1199/2373] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:14.175657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.176675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.177252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.177883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.178685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.198549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.202809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.230215 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1175/2374] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:14.268941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2de9-4afd-413b-a651-919c696db9cf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.277354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.278778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.279070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.279388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.280958 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.283709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.309618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1200/2375] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:14 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:14.315083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.325666 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a24b-cacb-4878-ab5b-3b6a27bcca91 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.331134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.331700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.332106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.332507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.333295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.334749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.349637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1176/2376] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:14.350451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.363087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582bfca-dd0c-4667-848e-7e851a4b6c1a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.368149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.368713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.369013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.369298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.369998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.371644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f039e-e9ab-46e1-b834-fb46526be5ff admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.385028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1201/2377] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:58:14.390039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.403519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c58bb-65c5-4444-8215-746f4ccbdc1e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.408413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.409176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.410180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.410180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] PATH_INFO: `/v3/projects/8e773a0501f74445a2bff1a2de827f43/users/518bd6829ab64b7c8f2bb92ce85a9335/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.429249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e773a0501f74445a2bff1a2de827f43, user_id=518bd6829ab64b7c8f2bb92ce85a9335, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.432264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.450056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1177/2378] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:14 2022] PUT /identity/v3/projects/8e773a0501f74445a2bff1a2de827f43/users/518bd6829ab64b7c8f2bb92ce85a9335/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:14.462477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.462764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.463039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.493075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] MFA Rules not processed for user `518bd6829ab64b7c8f2bb92ce85a9335`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:14.494341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.567042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1202/2379] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:14.571389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.623234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:14.643382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d50c0f-a2c5-469a-9649-5fd7235b9bb6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.651802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.651967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.653358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.653565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.654020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.654020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.654750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.656928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.681320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25246239-41e7-4ec2-ba48-5df8c1b8526b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.684165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.685693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.686126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.686512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] PATH_INFO: `/v3/projects/0690b11796924a2facd59fb5bd51f50d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.688477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0690b11796924a2facd59fb5bd51f50d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.690591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.701371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1178/2380] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:14.705462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.743182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:14.746405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0690b11796924a2facd59fb5bd51f50d', 'request_id': 'req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.755839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0690b11796924a2facd59fb5bd51f50d', 'request_id': 'req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.764715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0690b11796924a2facd59fb5bd51f50d', 'request_id': 'req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.778436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] The token cache is being invalidate because project 0690b11796924a2facd59fb5bd51f50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:14.778727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.779519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.781320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1203/2381] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:14 2022] DELETE /identity/v3/projects/0690b11796924a2facd59fb5bd51f50d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:14.785394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba653-eb7d-4af2-8191-d1707a2f1d73 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.785942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.787432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.846576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.847217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.847495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.847807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.848453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.850499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.865482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f6bd-3f66-4862-8ea7-eeb516fb0adc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.870752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.871399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.871680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.871798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1179/2382] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:14 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:14.871960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] PATH_INFO: `/v3/users/25b14de135974c2086b2e3500cde4d6d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.873181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b14de135974c2086b2e3500cde4d6d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.875516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.875732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.877536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.889645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e0cd-3733-4063-8f2f-5a7d3820af78 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:14.895049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:14.895756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:14.896042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:14.896362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] PATH_INFO: `/v3/users/5fc045c3d983460d98925fb56eaed481` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:14.897625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc045c3d983460d98925fb56eaed481)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:14.899737 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:14.925199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b14de135974c2086b2e3500cde4d6d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.925981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b14de135974c2086b2e3500cde4d6d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.926844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b14de135974c2086b2e3500cde4d6d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.935381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b14de135974c2086b2e3500cde4d6d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.949032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b14de135974c2086b2e3500cde4d6d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.956218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc045c3d983460d98925fb56eaed481'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.957028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc045c3d983460d98925fb56eaed481'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.963942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1204/2383] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:14 2022] DELETE /identity/v3/users/25b14de135974c2086b2e3500cde4d6d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:14.964797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:14.966171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:14.967313 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc045c3d983460d98925fb56eaed481'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.968467 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc045c3d983460d98925fb56eaed481'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:14.975213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:14.984720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c055e36f-48c8-4904-bd97-2a34b8b43e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc045c3d983460d98925fb56eaed481'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.007207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1180/2384] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:14 2022] DELETE /identity/v3/users/5fc045c3d983460d98925fb56eaed481 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:15.008673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.008998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.009331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.030824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:15.032542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.035642 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:15.051099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac90c50-084f-4fe8-a70e-ebe903b6b0c7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.147695 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1181/2385] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:15.175239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.175874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.177168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.177456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.177961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.179289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.179754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.185089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.211901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1205/2386] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:15.217807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.223496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.246730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba84ece-cbb1-4c2c-955e-8e39b2ee8c24 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.259033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.259900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.260184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.260464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] PATH_INFO: `/v3/projects/0c4b724514cc43c3b9b340a676cc0157/users/7bef2c538cfb4066b64a167c9929aca8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.288104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4b724514cc43c3b9b340a676cc0157, user_id=7bef2c538cfb4066b64a167c9929aca8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.291751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.302944 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469c029-567b-4479-9791-a3b4241f0afa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.311282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1206/2387] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:15 2022] PUT /identity/v3/projects/0c4b724514cc43c3b9b340a676cc0157/users/7bef2c538cfb4066b64a167c9929aca8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:15.316589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.377429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.378245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.378626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.379026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.451983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995b6a-4e78-443f-9048-ed9e13f8582d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.459180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:15.461778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.462719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.463416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.463965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.465052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.468611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.485186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.485186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215646-8866-4628-be0b-f63af0007adb service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.486800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1207/2388] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 06:58:15.488717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.499856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1182/2389] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:15.503081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7a4de-c63c-4633-9ca8-61539477b360 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.508041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.508754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.509063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.509332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] PATH_INFO: `/v3/projects/0c4b724514cc43c3b9b340a676cc0157/users/7bef2c538cfb4066b64a167c9929aca8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.513347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4b724514cc43c3b9b340a676cc0157, user_id=7bef2c538cfb4066b64a167c9929aca8, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.514623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.531920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1208/2390] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:15 2022] PUT /identity/v3/projects/0c4b724514cc43c3b9b340a676cc0157/users/7bef2c538cfb4066b64a167c9929aca8/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:15.542668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.543833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.544260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.555935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.557885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.601194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] MFA Rules not processed for user `7bef2c538cfb4066b64a167c9929aca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:15.603975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.673461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:15.693139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec04c2-7dd6-4974-b93e-baebf81c04a5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.701181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.702023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.702449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.702822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] PATH_INFO: `/v3/projects/98f6f010707c466dafba024670a87d49` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.704900 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f6f010707c466dafba024670a87d49)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:15.707669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:15.760479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1183/2391] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:15.783385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:15.790407 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.810962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f6f010707c466dafba024670a87d49', 'request_id': 'req-c4e01d26-29e4-4872-836a-af2d9bee18ea'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.810962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f6f010707c466dafba024670a87d49', 'request_id': 'req-c4e01d26-29e4-4872-836a-af2d9bee18ea'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.818166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f6f010707c466dafba024670a87d49', 'request_id': 'req-c4e01d26-29e4-4872-836a-af2d9bee18ea'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.840352 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] The token cache is being invalidate because project 98f6f010707c466dafba024670a87d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:15.840946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.856034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4e01d26-29e4-4872-836a-af2d9bee18ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:15.864305 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1209/2392] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:15 2022] DELETE /identity/v3/projects/98f6f010707c466dafba024670a87d49 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:15.869906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.870199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.870476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:15.898362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:15.899941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:15.919465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a37b48-3145-4f2f-b0b4-b8d7c2fbee77 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:15.997671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:15.998299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:15.998717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:15.999219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1210/2393] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:16.000308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.002335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:16.014289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.017109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594140-b4ac-4262-975d-473ff7dbb29c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.030771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:16.066442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.067994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.068300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.068590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] PATH_INFO: `/v3/projects/7136379aa8fa42daa8128b7fe419bea1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.073963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7136379aa8fa42daa8128b7fe419bea1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.075870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.098010 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:16.121063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.122801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c33a01-c047-47d9-bf4d-70df3a8c8385 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.134788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1184/2394] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:16.136362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.136847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.137218 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.181699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:16.182925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:16.185827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7136379aa8fa42daa8128b7fe419bea1', 'request_id': 'req-e4460d57-aa2c-4865-8287-6bffd5909e87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:16.197665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7136379aa8fa42daa8128b7fe419bea1', 'request_id': 'req-e4460d57-aa2c-4865-8287-6bffd5909e87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:16.215246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7136379aa8fa42daa8128b7fe419bea1', 'request_id': 'req-e4460d57-aa2c-4865-8287-6bffd5909e87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:16.254202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] The token cache is being invalidate because project 7136379aa8fa42daa8128b7fe419bea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:16.255426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:16.256886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:16.262771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1211/2395] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:15 2022] DELETE /identity/v3/projects/7136379aa8fa42daa8128b7fe419bea1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:16.352676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1185/2396] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:16.358400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.384490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460d57-aa2c-4865-8287-6bffd5909e87 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.415547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.418325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.418325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.418579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.426581 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:16.426905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.428608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.438052 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:16.471413 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1212/2397] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:16.473211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.488531 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd41d-af7a-4fbf-8e82-c41019464fa7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.509279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.510650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.511966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.513157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.514361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.520115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.589066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1186/2398] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:16 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:16.592872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.610361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d29a-64f2-43cd-a1d1-17daba94ba98 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.736142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.736794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.737095 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.737375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.738060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.739981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.780839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1213/2399] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:16 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:16.785186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.799357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4090ab-6baf-480d-b9ba-ea46b6c6a0d7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.804478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.805271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.805651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.806026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.807017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.809329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.823201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1187/2400] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:16.826665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.839209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e82cf-1d4b-4185-b7bc-4fa2aee601e3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.844176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.846153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.846153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.846153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.846494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.849073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ab18-fffe-480e-8acf-63099ad2c626 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.861594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1214/2401] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:16.866223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:16.878951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e095c40-5e13-471a-bb2a-4f8e81a7a63d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:16.886646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:16.887340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.887624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.887905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] PATH_INFO: `/v3/projects/eeb458ebd35a41feab325e7f58016f59/users/1e3c3557251c4fc8831bb9bd84cfb19c/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.909381 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb458ebd35a41feab325e7f58016f59, user_id=1e3c3557251c4fc8831bb9bd84cfb19c, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:16.912422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:16.927707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1188/2402] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:16 2022] PUT /identity/v3/projects/eeb458ebd35a41feab325e7f58016f59/users/1e3c3557251c4fc8831bb9bd84cfb19c/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:16.939065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:16.939478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:16.939770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:16.967853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] MFA Rules not processed for user `1e3c3557251c4fc8831bb9bd84cfb19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:16.969618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:17.037348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1215/2403] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:17.049494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:17.051211 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:17.107490 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661024-5744-433c-a7c2-67d971e41532 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:17.111852 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:17.112460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:17.112735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:17.113044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:17.121141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:17.122569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:17.131331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1189/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:18.067589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:18.069133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:18.081467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a270c-bb1e-4275-830a-1851c003c2f6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:18.084997 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:18.085634 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:18.085914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:18.086188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:18.087908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:18.155159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:18.156683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:18.166638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1216/2405] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:18.816851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:18.826949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0e7e-3fbf-43eb-af7c-30a750996de7 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:18.830694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:18.831302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:18.831575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:18.831840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:18.833705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:18.867957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:18.911229 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:18.912972 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9fde7-9d2d-4aff-97ab-fc1a49762a32 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:18.924391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1190/2406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:19.747306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:19.753438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:19.831810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325d0ff-5b82-421e-a240-7f220d889d4c service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:19.837905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:19.838721 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:19.839057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:19.839432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] PATH_INFO: `/v3/users/1e3c3557251c4fc8831bb9bd84cfb19c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:19.840707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3c3557251c4fc8831bb9bd84cfb19c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:19.842782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:19.902145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3c3557251c4fc8831bb9bd84cfb19c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:19.902828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3c3557251c4fc8831bb9bd84cfb19c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:19.903498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3c3557251c4fc8831bb9bd84cfb19c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:19.911228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3c3557251c4fc8831bb9bd84cfb19c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:19.923400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3c3557251c4fc8831bb9bd84cfb19c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:19.939637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1217/2407] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:19 2022] DELETE /identity/v3/users/1e3c3557251c4fc8831bb9bd84cfb19c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:19.944719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39319c-7965-429b-b66a-eff14e86cd2a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:19.945241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39319c-7965-429b-b66a-eff14e86cd2a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:19.945353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39319c-7965-429b-b66a-eff14e86cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:19.964395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5f39319c-7965-429b-b66a-eff14e86cd2a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:19.965619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5f39319c-7965-429b-b66a-eff14e86cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.033151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1191/2408] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:20.044709 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:20.046023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.073019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3644-4b19-4516-ba00-ccc200968236 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.073298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3644-4b19-4516-ba00-ccc200968236 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.073576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3644-4b19-4516-ba00-ccc200968236 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.074958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1192/2409] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 06:58:20.082137 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638be9b-2982-44aa-9d6e-160df3aaf8ed None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.082619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638be9b-2982-44aa-9d6e-160df3aaf8ed None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.083052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638be9b-2982-44aa-9d6e-160df3aaf8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.126947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf677ba-50a0-42f5-bcd3-f19761696351 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:20.131204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:20.132293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.132690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.133188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.139168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6638be9b-2982-44aa-9d6e-160df3aaf8ed None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:20.140392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6638be9b-2982-44aa-9d6e-160df3aaf8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.145924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:20.147498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:20.160814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1218/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:20.270677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1193/2411] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:58:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:20.291342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:20.293155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.348000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:20.428059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096acfa-ca0e-4383-a28e-19e4e1605722 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:20.433624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:20.434565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.434986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.435399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.459773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:20.461250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972867e-2393-4edb-b098-1f9d6ed66f0e service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:20.496178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1219/2412] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:20.599360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.599646 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.599928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.601672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1194/2413] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:58:20.606057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.606346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.606655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.630550 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:20.631760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.636454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:20.638228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.638899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1220/2414] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:58:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:20.656023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00c7a-058b-4cd8-8167-21fab83ad0ac None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:20.657326 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:20.658834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.661690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:20.662696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.662975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.663251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] PATH_INFO: `/v3/projects/eeb458ebd35a41feab325e7f58016f59` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.664441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb458ebd35a41feab325e7f58016f59)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:20.666966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:20.670142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c269-7cfc-4b66-9c52-c88e8cdf0399 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:20.674892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:20.675478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.675768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.676043 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.684300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:20.685591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30602050-f8b6-4b29-9b50-581809732d9b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:20.694242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1221/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 06:58:20.724951 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb458ebd35a41feab325e7f58016f59', 'request_id': 'req-9a5b8646-5e56-4220-a857-951ab4fa4b52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:20.726331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:20.732069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb458ebd35a41feab325e7f58016f59', 'request_id': 'req-9a5b8646-5e56-4220-a857-951ab4fa4b52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:20.739235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb458ebd35a41feab325e7f58016f59', 'request_id': 'req-9a5b8646-5e56-4220-a857-951ab4fa4b52'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:20.752049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] The token cache is being invalidate because project eeb458ebd35a41feab325e7f58016f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:20.752339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:20.753031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9a5b8646-5e56-4220-a857-951ab4fa4b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:20.754641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1195/2416] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:20 2022] DELETE /identity/v3/projects/eeb458ebd35a41feab325e7f58016f59 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:20.782133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435651d-044f-403b-a52d-339cdd59678c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.783121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435651d-044f-403b-a52d-339cdd59678c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.783406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435651d-044f-403b-a52d-339cdd59678c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.784824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1222/2417] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 06:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 06:58:20.791011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.791302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.791589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:20.814786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:20.816130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.904452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1196/2418] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 06:58:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:20.918854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435651d-044f-403b-a52d-339cdd59678c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:20.921705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8435651d-044f-403b-a52d-339cdd59678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:20.988874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435651d-044f-403b-a52d-339cdd59678c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:20.992492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:20.993136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:20.993420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:20.993694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:21.004422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:21.006022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88d46c-7627-4483-b938-7d1830bf78ca service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:21.018922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1223/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:23.211134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:23.212526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:23.307502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78fff-2a7b-485c-8488-e3cb7cc4e3e8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:23.312329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:23.313662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:23.313943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:23.314194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] PATH_INFO: `/v3/users/9c35511501934834b75f91f4aa7cfe23` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:23.315459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c35511501934834b75f91f4aa7cfe23)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:23.317431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:23.380177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c35511501934834b75f91f4aa7cfe23'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:23.381244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c35511501934834b75f91f4aa7cfe23'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:23.391651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c35511501934834b75f91f4aa7cfe23'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:23.392472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c35511501934834b75f91f4aa7cfe23'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:23.404528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:23.406114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c35511501934834b75f91f4aa7cfe23'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:23.421232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1197/2420] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:23 2022] DELETE /identity/v3/users/9c35511501934834b75f91f4aa7cfe23 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:23.425899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:23.426629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:23.426916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:23.446947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:23.448358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:23.515153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1224/2421] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:23.525043 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:23.526628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:23.593659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b89107-30dd-443c-85f8-8e97bc3903e0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:23.598843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:23.599506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:23.599820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:23.600055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:23.611124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:23.612568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:23.622282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1198/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:24.283338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:24.285130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:24.296513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71262161-7a29-4244-aee5-5a013f2f8b05 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:24.302150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:24.302671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:24.302949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:24.303228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] PATH_INFO: `/v3/projects/fcd28601c79a4153adffa2e7287db84c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:24.304402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd28601c79a4153adffa2e7287db84c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:24.306405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:24.369647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:24.375678 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd28601c79a4153adffa2e7287db84c', 'request_id': 'req-166bab54-f37c-4369-acd9-588fa293a742'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.383720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd28601c79a4153adffa2e7287db84c', 'request_id': 'req-166bab54-f37c-4369-acd9-588fa293a742'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.399450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd28601c79a4153adffa2e7287db84c', 'request_id': 'req-166bab54-f37c-4369-acd9-588fa293a742'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.413278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] The token cache is being invalidate because project fcd28601c79a4153adffa2e7287db84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:24.413731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.414529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-166bab54-f37c-4369-acd9-588fa293a742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.416230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1225/2423] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:24 2022] DELETE /identity/v3/projects/fcd28601c79a4153adffa2e7287db84c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:24.420239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:24.430231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96608c-c71e-4eea-97d4-4540df39c0ad service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:24.505418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:24.506107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:24.506384 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:24.506659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] PATH_INFO: `/v3/users/518bd6829ab64b7c8f2bb92ce85a9335` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:24.507845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518bd6829ab64b7c8f2bb92ce85a9335)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:24.509919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:24.559223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518bd6829ab64b7c8f2bb92ce85a9335'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.559876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518bd6829ab64b7c8f2bb92ce85a9335'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.567453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518bd6829ab64b7c8f2bb92ce85a9335'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.568196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518bd6829ab64b7c8f2bb92ce85a9335'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.582880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518bd6829ab64b7c8f2bb92ce85a9335'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:24.603671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1199/2424] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:24 2022] DELETE /identity/v3/users/518bd6829ab64b7c8f2bb92ce85a9335 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:24.673807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f9-0e66-4258-858f-3edd6832fcf5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:24.674403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f9-0e66-4258-858f-3edd6832fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:24.674403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f9-0e66-4258-858f-3edd6832fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:24.702620 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-48ade8f9-0e66-4258-858f-3edd6832fcf5 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:24.704705 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-48ade8f9-0e66-4258-858f-3edd6832fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:24.774645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1226/2425] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:58:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:24.797560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:24.799231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:24.814094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:24.865308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:24.865591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:24.865873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:24.886050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] MFA Rules not processed for user `4dfe597e0add46df8556475fbd4596df`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:24.886820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d818f-084b-47f4-a4e2-e5acba94b516 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:24.887244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:24.892566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:24.893225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:24.893817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:24.893817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:24.905847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:24.908343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:24.920868 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1200/2426] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:58:24.930360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:24.931923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:24.968812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1227/2427] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:25.110615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25fb3c-343a-4bed-8428-b0d7e62a188b service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:25.126147 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:25.129145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:25.130189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:25.130780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] PATH_INFO: `/v3/projects/8e773a0501f74445a2bff1a2de827f43` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:25.136591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e773a0501f74445a2bff1a2de827f43)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:25.144617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:25.286757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e773a0501f74445a2bff1a2de827f43', 'request_id': 'req-75870340-db3c-426d-a3a5-64836e0b3d83'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.302492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e773a0501f74445a2bff1a2de827f43', 'request_id': 'req-75870340-db3c-426d-a3a5-64836e0b3d83'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.319223 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e773a0501f74445a2bff1a2de827f43', 'request_id': 'req-75870340-db3c-426d-a3a5-64836e0b3d83'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.347087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] The token cache is being invalidate because project 8e773a0501f74445a2bff1a2de827f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:25.347424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.350297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.354021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1201/2428] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:24 2022] DELETE /identity/v3/projects/8e773a0501f74445a2bff1a2de827f43 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:25.360911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:25.381296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0db576-799a-4841-a681-b9be5e4f1d9f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:25.560662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:25.562006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:25.562510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:25.563481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] PATH_INFO: `/v3/users/7bef2c538cfb4066b64a167c9929aca8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:25.575424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bef2c538cfb4066b64a167c9929aca8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:25.577018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:25.635140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:25.663385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bef2c538cfb4066b64a167c9929aca8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.663385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bef2c538cfb4066b64a167c9929aca8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.663922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bef2c538cfb4066b64a167c9929aca8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.690290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bef2c538cfb4066b64a167c9929aca8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.722696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b04f50c8-e4d9-457c-ac0c-eb3975187b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bef2c538cfb4066b64a167c9929aca8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:25.752885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1228/2429] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 06:58:25 2022] DELETE /identity/v3/users/7bef2c538cfb4066b64a167c9929aca8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:26.256612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:26.258172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:26.275360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870340-db3c-426d-a3a5-64836e0b3d83 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:26.356702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:26.449109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:26.450198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:26.451232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:26.452634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] PATH_INFO: `/v3/projects/0c4b724514cc43c3b9b340a676cc0157` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:26.456929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4b724514cc43c3b9b340a676cc0157)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:26.463335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:26.543001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4b724514cc43c3b9b340a676cc0157', 'request_id': 'req-9c41b19e-6dc2-45a2-823e-66e55968964e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:26.554529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4b724514cc43c3b9b340a676cc0157', 'request_id': 'req-9c41b19e-6dc2-45a2-823e-66e55968964e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:26.563849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4b724514cc43c3b9b340a676cc0157', 'request_id': 'req-9c41b19e-6dc2-45a2-823e-66e55968964e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:26.587067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] The token cache is being invalidate because project 0c4b724514cc43c3b9b340a676cc0157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 06:58:26.592602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:26.593616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9c41b19e-6dc2-45a2-823e-66e55968964e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 06:58:26.604264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1202/2430] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 06:58:26 2022] DELETE /identity/v3/projects/0c4b724514cc43c3b9b340a676cc0157 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:26.605982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:26.606274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:26.606641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:26.646990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:26.648339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:26.800969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1229/2431] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:26.808669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:26.809077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:26.809365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:26.832735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:26.834195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:26.843818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1203/2432] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:26.848584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:26.861692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584049-eec2-4553-ac7a-0e7db5e71ffe None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:26.867060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:26.867857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:26.868226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:26.868765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:26.869635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 06:58:26.870036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:26.873409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:26.895695 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1230/2433] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 06:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 06:58:26.898310 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:26.907978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca880cd-43aa-4cb5-8981-05ab50cb2356 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:26.913544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:26.914435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:26.914909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:26.915374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:26.916227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:26.925771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:26.969026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1204/2434] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:26.972281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:26.982761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f6ea-1197-4fc0-9e9e-d4e58a162f95 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:27.050288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:27.051004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.051348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.051686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.052454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:27.054497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:27.077279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1231/2435] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:26 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:27.082074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:27.093022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b20b6-1c6c-4b13-af5c-ff1410aa7466 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:27.099634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:27.100268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.100548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.100826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.101556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:27.103916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:27.117877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1205/2436] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:27.121200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:27.135686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024dd1-1764-497d-aabf-4a9d32613069 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:27.142086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:27.142722 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.143012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.143289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.143993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:27.145702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef597-ff05-4d94-b8d2-2fba32320f85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:27.158377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1232/2437] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:27.162988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:27.178963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7378-5a8f-4cb2-994d-ab06250b7d19 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:27.185940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:27.186877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.187408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.188405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] PATH_INFO: `/v3/projects/62dc6a938561444e83f9ab8eff5481f6/users/0c8ad00e5cf544eca4f3c7385d9c3bf9/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.209570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dc6a938561444e83f9ab8eff5481f6, user_id=0c8ad00e5cf544eca4f3c7385d9c3bf9, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:27.212903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:27.227334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1206/2438] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:27 2022] PUT /identity/v3/projects/62dc6a938561444e83f9ab8eff5481f6/users/0c8ad00e5cf544eca4f3c7385d9c3bf9/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 06:58:27.232714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a62aa-9123-4b3f-bf56-c2b1718da887 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.233020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a62aa-9123-4b3f-bf56-c2b1718da887 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.233300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a62aa-9123-4b3f-bf56-c2b1718da887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.254567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-089a62aa-9123-4b3f-bf56-c2b1718da887 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:27.256309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-089a62aa-9123-4b3f-bf56-c2b1718da887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:27.261232 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:27.346010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1233/2439] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:27.352730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:27.354729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:27.427541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9bbc0-7645-4650-80cd-d190cd5eba0a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:27.431299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:27.431950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:27.432224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:27.432496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:27.441907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:27.443343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:27.448484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:27.454028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1207/2440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:33.803567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:33.804185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:33.804185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:33.836921 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] MFA Rules not processed for user `0c8ad00e5cf544eca4f3c7385d9c3bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:33.838252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:33.910418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1234/2441] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:33.915429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:33.926176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256171-a1d6-4f21-b283-4767247db889 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:33.931481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:33.931481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:33.931481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:33.931481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:33.936148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:33.936148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:33.963558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1208/2442] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 06:58:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 06:58:33.967653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:33.979126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b6a4-3142-42a7-9bd7-9e5ba24ffd1b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:34.037769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:34.038422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:34.039318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:34.039608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:34.040301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:34.042278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:34.064336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1235/2443] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 06:58:33 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 06:58:34.068637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:34.080382 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104a4b-e21d-4603-bf0c-a10af13ec78d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:34.085261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:34.085886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:34.086175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:34.086451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:34.087329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:34.089451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:34.104593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1209/2444] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:34.108825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:34.120286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5127-5a97-4464-8ee3-0a49d6bf0669 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:34.125045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:34.125841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:34.126127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:34.126404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] PATH_INFO: `/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e/users/32dfe7827c1c46cca20f3fe1ffa9c847/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:34.141615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea17e802d2a4b429a87ae9f33a0c09e, user_id=32dfe7827c1c46cca20f3fe1ffa9c847, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:34.144557 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:34.159558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1236/2445] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:34 2022] PUT /identity/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e/users/32dfe7827c1c46cca20f3fe1ffa9c847/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:34.163527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:34.175727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52e46-9386-4de8-8501-3ae6f265056d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:34.235502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:34.236129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:34.236406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:34.236676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:34.237390 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:34.238980 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e173-4c66-4298-997c-209f6fde4ec1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:34.249134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1210/2446] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 06:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 06:58:34.253321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:34.260056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:34.264163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2dbb9-f1f4-493e-940c-0f2d144e76ec admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:34.271244 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:34.271942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:34.272255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:34.272481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] PATH_INFO: `/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e/users/32dfe7827c1c46cca20f3fe1ffa9c847/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:34.275575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea17e802d2a4b429a87ae9f33a0c09e, user_id=32dfe7827c1c46cca20f3fe1ffa9c847, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:34.278243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:34.293029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1237/2447] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 06:58:34 2022] PUT /identity/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e/users/32dfe7827c1c46cca20f3fe1ffa9c847/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 06:58:40.414424 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6005d-e6ac-4152-9e09-79c50488cd24 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:40.414971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6005d-e6ac-4152-9e09-79c50488cd24 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:40.414971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6005d-e6ac-4152-9e09-79c50488cd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:40.451461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-27f6005d-e6ac-4152-9e09-79c50488cd24 None None] MFA Rules not processed for user `32dfe7827c1c46cca20f3fe1ffa9c847`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:40.453594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-27f6005d-e6ac-4152-9e09-79c50488cd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:40.550479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1211/2448] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:40.563122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:40.564960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:40.629852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14f3c-de61-4571-92a2-3791ae254dfb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:40.634086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:40.634262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:40.634541 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:40.635440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:40.699346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:40.700801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:40.711555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1238/2449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:40.838939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:40.839709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:40.839993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:40.860434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:40.861717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:40.908712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:40.922292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1212/2450] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:58:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:40.934308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:40.935688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:41.022056 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c3eb-d693-4e62-a5ec-29361eae545b service glance] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:41.027296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:41.028011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:41.028362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:41.028643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:41.038050 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:41.040008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1d75-3d3e-4b22-977b-2be033097ac5 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:41.049160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1239/2451] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:58:44.558064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:44.639209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f006a4-9349-4e02-88a9-3c18560a68f2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:44.646225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:44.646997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:44.647291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:44.647632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:44.652366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:44.760869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:44.762586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:44.778824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1213/2452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:48.311447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a07d0-0f7a-417a-bf3c-de550bfd12c4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:48.312664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a07d0-0f7a-417a-bf3c-de550bfd12c4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:48.312664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a07d0-0f7a-417a-bf3c-de550bfd12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:48.344255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-da8a07d0-0f7a-417a-bf3c-de550bfd12c4 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:48.345758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-da8a07d0-0f7a-417a-bf3c-de550bfd12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:48.362225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1240/2453] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 06:58:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:48.373604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:48.388778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039494c5-5447-4392-a003-29a2d22b6c33 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:48.395969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:48.396795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:48.397109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:48.397387 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:48.406496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:48.408085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:48.421253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1214/2454] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:58:53.057996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0626-3cef-49ef-b411-2f44c039bcc7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:53.058600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0626-3cef-49ef-b411-2f44c039bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:53.058600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0626-3cef-49ef-b411-2f44c039bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:53.080148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9fde0626-3cef-49ef-b411-2f44c039bcc7 None None] MFA Rules not processed for user `0c8ad00e5cf544eca4f3c7385d9c3bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:53.081392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9fde0626-3cef-49ef-b411-2f44c039bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:53.092893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1241/2455] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 06:58:54.643232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:54.645580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:54.735769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7420-fffd-4c3b-adbe-4501072e23d4 service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:54.744116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:54.745304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:54.745810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:54.746314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:54.750141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:54.770141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:54.771832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219486d5-9183-4058-9f60-b98833a5ed93 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:54.782565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1215/2456] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:58:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:58:55.135768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:55.136820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:55.137309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:55.160756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] MFA Rules not processed for user `c03cd88d3da44d0f8b067d9140c225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:55.162094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:55.184902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:58:55.247382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1242/2457] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:58:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:56.195299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:56.195775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:56.195883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:56.216584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:58:56.218119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:58:56.227970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1216/2458] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 06:58:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:58:56.246017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:58:56.261742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909493-8773-4cc9-8c6b-4ea68c79668a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:58:56.268542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:58:56.269834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:58:56.270361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:58:56.270849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:58:56.282805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:58:56.284465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1221e-553c-44f9-be53-3242457beffb service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:58:56.295490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1243/2459] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 06:58:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 06:59:06.210919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:59:06.290760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=21 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:59:28.637508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 06:59:28.647641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b7175-fc5f-4b55-8b39-a03c97a83121 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 06:59:28.651214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 06:59:28.651818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:59:28.652090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:59:28.652358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:59:28.662040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 06:59:28.663460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93662362-aa09-478e-84d6-1eeb33d6f1f6 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 06:59:28.672919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1217/2460] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 06:59:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 06:59:38.668672 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 06:59:41.497614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693a48-ddc2-49a3-be5b-3d84cb746604 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 06:59:41.498173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693a48-ddc2-49a3-be5b-3d84cb746604 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 06:59:41.498173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693a48-ddc2-49a3-be5b-3d84cb746604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 06:59:41.518426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e1693a48-ddc2-49a3-be5b-3d84cb746604 None None] MFA Rules not processed for user `36ce2b6904ef4be4bea04cebcc2a5aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 06:59:41.519766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e1693a48-ddc2-49a3-be5b-3d84cb746604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 06:59:41.575563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1244/2461] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 06:59:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 06:59:51.568913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=25 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:00:15.184715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:15.185404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:15.185404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:15.204900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] MFA Rules not processed for user `4dfe597e0add46df8556475fbd4596df`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:00:15.206112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:15.260069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1218/2462] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:00:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:00:23.828198 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:23.828730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:23.828730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:23.974318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] MFA Rules not processed for user `c03cd88d3da44d0f8b067d9140c225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:00:23.975410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:23.983141 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1245/2463] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:00:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:00:25.253525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=25 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:00:32.769738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:00:32.771181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:32.783807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc04d57-c59d-4e5a-8e38-30a7c4f4805b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:00:32.787350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:00:32.787955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:32.788235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:32.788511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:32.790242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:32.861969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:00:32.863451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:00:32.874548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1219/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:00:33.339811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:00:33.350369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fdd00-2e29-41be-a04c-d1a66e031d30 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:00:33.354274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:00:33.354878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:33.355150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:33.355415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:33.357417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:33.370252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:00:33.371669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c5e3a-f232-4c5f-956d-a0378bba85e4 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:00:33.383193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1246/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:00:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:00:42.869419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=34 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:00:42.926585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:00:42.927959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:42.941899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1f60-d584-4621-9689-c06bf4b4e514 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:00:42.947462 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:00:42.948112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:42.948450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:42.948784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:42.950691 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:42.961237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:00:42.962804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:00:42.972659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1220/2466] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:00:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:00:43.378341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=9 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:00:51.653475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:51.654023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:51.654023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:51.672756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:00:51.673974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:51.681146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1247/2467] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 07:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:00:51.721455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:00:51.733161 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ee41-303a-4971-a30c-041ba1ab5d64 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:00:51.738264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:00:51.738867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:51.739144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:51.739415 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:51.747347 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:00:51.749731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:00:51.757908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1221/2468] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 07:00:59.185543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:00:59.198720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0888232-acb7-49e7-8de7-678d6127f017 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:00:59.204048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:00:59.205019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:00:59.205414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:00:59.206101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:00:59.207979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:00:59.221179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:00:59.222773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:00:59.237285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1248/2469] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:00:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:01.754425 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=12 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:02.850435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:02.851940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:02.910958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75132d-626c-4f32-bf1a-45928f2c18fb service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:02.914589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:02.915207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:02.915485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:02.915756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:02.917514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:02.928683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:02.930159 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:02.939362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1222/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:08.821514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:08.823164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:08.849474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31677a-c14a-41fc-b26d-bb7e4aa145b3 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:08.869229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:08.869229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:08.869229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:08.869229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:08.869743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:08.882109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:08.885288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9535b-1afb-4754-8306-a9b4bec1e97d service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:08.890174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:08.904478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcdb6-2960-4aaa-867d-54a932a77bce service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:08.911098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:08.912112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:08.912548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:08.913065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1249/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:08.913255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:08.915372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:08.929558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:08.931402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:08.943716 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1223/2472] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:01:14.966682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:14.967763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:14.967877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:14.977797 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=16 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:14.998328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:14.999592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:15.019897 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1250/2473] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 07:01:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:15.031644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:15.045525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bfa35-e03c-4b8c-b501-4a9d17960346 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:15.051304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:15.051993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:15.052301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:15.052772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:15.063834 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:15.065645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc9f93-b021-47aa-bdcd-0a5a1d5cf4e5 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:15.074470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1224/2474] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 07:01:16.138179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:16.155553 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba926a-c93b-434a-84fc-a7592f9a481d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:16.159609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:16.160454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.160731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.161250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.163369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:16.178335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:16.180408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08b55-2f1f-403e-b476-8bdb2326bf23 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:16.193380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1251/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:16.474315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eae7-a948-47ba-bab3-d74f6a7e605b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.474845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eae7-a948-47ba-bab3-d74f6a7e605b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.475023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eae7-a948-47ba-bab3-d74f6a7e605b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.476518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1225/2476] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 07:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 07:01:16.484790 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db8b4-8910-4596-98e7-529709395f81 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.485089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db8b4-8910-4596-98e7-529709395f81 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.485365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db8b4-8910-4596-98e7-529709395f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.505990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-843db8b4-8910-4596-98e7-529709395f81 None None] MFA Rules not processed for user `23d27ceb5baf4b71b2ae60975e787151`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:16.507325 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-843db8b4-8910-4596-98e7-529709395f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:16.514403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1252/2477] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 07:01:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:16.527468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40eae7-a948-47ba-bab3-d74f6a7e605b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:16.541033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40eae7-a948-47ba-bab3-d74f6a7e605b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:16.545709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:16.546510 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.546945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.547468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.556558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:16.559561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3965df-6e4f-40b3-8c7e-19344434228a service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:16.576594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1226/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:16.668445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.670433 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.670717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.675004 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee03d-0eff-4be3-bb16-72ae58b97292 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.675566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee03d-0eff-4be3-bb16-72ae58b97292 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.675841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee03d-0eff-4be3-bb16-72ae58b97292 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.677331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1227/2479] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 07:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 07:01:16.690524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.690807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.691080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.711574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:16.713984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:16.725037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1253/2480] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 07:01:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:16.732876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] MFA Rules not processed for user `2245988d98b1408bba171ce6979796b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:16.733580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:16.739215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:16.751388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1228/2481] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 07:01:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:16.751927 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6108c-48f7-4aa2-b19d-bc83edf79120 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:16.757629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:16.758432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:16.759089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.759362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.759656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.769959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:16.771631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926505b-bb0d-43df-858a-99fd4a2580b9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:16.771936 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:16.775460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:16.776088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:16.776710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:16.777100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:16.790604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:16.792341 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:16.792739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1254/2482] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 07:01:16.809478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1229/2483] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:21.005719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:21.022783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5056-32c3-47ca-ae61-d880fea95e59 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:21.030692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:21.031688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:21.032190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:21.032701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:21.041686 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:21.081691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:21.085233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:21.155601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1255/2484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:26.013992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:26.025718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052e544-5f67-4c51-bb10-a0b76c27361b service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:26.031759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:26.032380 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:26.032658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:26.032929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:26.034992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:26.049322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:26.050627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:26.083474 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:26.117018 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1230/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:26.177389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bdc38-2275-4aff-92eb-23d76bf266f9 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:26.181890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:26.182560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:26.182840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:26.183128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] PATH_INFO: `/v3/users/0c8ad00e5cf544eca4f3c7385d9c3bf9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:26.184426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8ad00e5cf544eca4f3c7385d9c3bf9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:26.186554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:26.232807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8ad00e5cf544eca4f3c7385d9c3bf9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.233496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8ad00e5cf544eca4f3c7385d9c3bf9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.234100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8ad00e5cf544eca4f3c7385d9c3bf9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.240694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8ad00e5cf544eca4f3c7385d9c3bf9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.252440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8ad00e5cf544eca4f3c7385d9c3bf9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.266978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1256/2486] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:01:26 2022] DELETE /identity/v3/users/0c8ad00e5cf544eca4f3c7385d9c3bf9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:26.443401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:26.456573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9efc5-2b87-4000-9e1e-b81da9c31ca7 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:26.516377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:26.517204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:26.517325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:26.517614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] PATH_INFO: `/v3/projects/62dc6a938561444e83f9ab8eff5481f6` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:26.518763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dc6a938561444e83f9ab8eff5481f6)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:26.520689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:26.555481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:26.568927 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dc6a938561444e83f9ab8eff5481f6', 'request_id': 'req-1bc4d096-7f09-4522-b349-d0fb42257e43'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.575219 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dc6a938561444e83f9ab8eff5481f6', 'request_id': 'req-1bc4d096-7f09-4522-b349-d0fb42257e43'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.581582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dc6a938561444e83f9ab8eff5481f6', 'request_id': 'req-1bc4d096-7f09-4522-b349-d0fb42257e43'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.594976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] The token cache is being invalidate because project 62dc6a938561444e83f9ab8eff5481f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:01:26.595272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.595896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.597451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1231/2487] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:01:26 2022] DELETE /identity/v3/projects/62dc6a938561444e83f9ab8eff5481f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:26.601559 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:26.602971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:26.616515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353064d8-c463-4526-9bdd-e4553f0dbc95 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:26.638416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:26.681941 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:26.682650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:26.682946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:26.683225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] PATH_INFO: `/v3/users/32dfe7827c1c46cca20f3fe1ffa9c847` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:26.685111 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dfe7827c1c46cca20f3fe1ffa9c847)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:26.687027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:26.733404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dfe7827c1c46cca20f3fe1ffa9c847'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.734042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dfe7827c1c46cca20f3fe1ffa9c847'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.734632 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dfe7827c1c46cca20f3fe1ffa9c847'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.741428 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dfe7827c1c46cca20f3fe1ffa9c847'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.753910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82427f8e-1c0c-47f8-a465-14cf7e14e152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dfe7827c1c46cca20f3fe1ffa9c847'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:26.766760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1257/2488] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:01:26 2022] DELETE /identity/v3/users/32dfe7827c1c46cca20f3fe1ffa9c847 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:01:26.951031 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:26.952640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:26.966441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d096-7f09-4522-b349-d0fb42257e43 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.038961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.039697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.040047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.040392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] PATH_INFO: `/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.041733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea17e802d2a4b429a87ae9f33a0c09e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.043731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.091481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea17e802d2a4b429a87ae9f33a0c09e', 'request_id': 'req-34b82b03-ce59-4447-89d6-cd05afb4d0da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:27.097055 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea17e802d2a4b429a87ae9f33a0c09e', 'request_id': 'req-34b82b03-ce59-4447-89d6-cd05afb4d0da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:27.103217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea17e802d2a4b429a87ae9f33a0c09e', 'request_id': 'req-34b82b03-ce59-4447-89d6-cd05afb4d0da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:27.116195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] The token cache is being invalidate because project eea17e802d2a4b429a87ae9f33a0c09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:01:27.116477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:27.117115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-34b82b03-ce59-4447-89d6-cd05afb4d0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:27.118769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1232/2489] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:01:26 2022] DELETE /identity/v3/projects/eea17e802d2a4b429a87ae9f33a0c09e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:27.124205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.124694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.124892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.144246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:27.145451 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:27.203850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1258/2490] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:27.212835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.213183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.213465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.235109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:27.236296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:27.244340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1233/2491] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:27.249545 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.259782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3799b4-1f76-438a-b428-d02ac369c207 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.264624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.265268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.265558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.265828 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.266549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:01:27.266853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.268437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.282327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1259/2492] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:01:27.286837 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.296940 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692307f8-7552-4990-bc5c-4364c97ac40a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.301653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.302880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.303164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.303440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.304103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.306072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.336819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1234/2493] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:27 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:27.340782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.351085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6127b1-feff-4c8a-aab2-780e131b2b9d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.378248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:27.410993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.411612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.411887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.412153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.412793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.414712 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.439208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1260/2494] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:27 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:27.443442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.453798 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702405c-7acd-4abf-b2fd-fade99421a2a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.458290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.458893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.459170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.459439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.460116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.461745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.472266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1235/2495] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:27.476256 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.488373 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba547-f432-47ba-bebf-7c1509d7922d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.493113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.493730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.494014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.494292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.494983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.496573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89847888-69b8-45d9-9c54-f56d8644fd5f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.507321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1261/2496] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:01:27.511506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.522198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711434e-3388-4419-bb14-7f92434f623f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.526904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.527564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.528443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.528935 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] PATH_INFO: `/v3/projects/1a35c85ffe5c48938eaf14dd1ab2395e/users/b17a00d68d66412aaddb2235efcc18f5/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.537479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:27.545963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a35c85ffe5c48938eaf14dd1ab2395e, user_id=b17a00d68d66412aaddb2235efcc18f5, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.549171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.562355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1236/2497] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:27 2022] PUT /identity/v3/projects/1a35c85ffe5c48938eaf14dd1ab2395e/users/b17a00d68d66412aaddb2235efcc18f5/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:27.567777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.567987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.568199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.587201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:27.588392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:27.661697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1262/2498] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:27.672532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:27.674487 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:27.746267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2e6a7-47e8-4c63-b23f-cd1ce9a1fcd5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:27.750408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:27.751224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:27.751456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:27.751555 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:27.764859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:27.766506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4fbb-6f79-4f06-96d8-175734027235 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:27.777012 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1237/2499] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:32.717710 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:32.726094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:32.839792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d8b3-6c4b-4d36-9108-064c3dc7114d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:32.846407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:32.847290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:32.847571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:32.848572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:32.852626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:32.869250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:32.871115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:32.884389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1263/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:33.277165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.278250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.278345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.309795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] MFA Rules not processed for user `b17a00d68d66412aaddb2235efcc18f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:33.311003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:33.391119 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1238/2501] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:33.395573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.407351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e7bd-5a3a-4177-ad89-baca227c249a service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.412776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.413431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.413905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.414188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.415188 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.416728 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.465980 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1264/2502] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:33 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:33.468503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.480338 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0426c-8f6b-4d6c-b029-269aee985817 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.544929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.545612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.545892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.546167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.546836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.548786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.572843 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1239/2503] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:33 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:33.577121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.587459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0e64c-ca24-409d-ad9c-fa6aef88ab41 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.592445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.593089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.593369 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.593644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.594599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.596571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.601882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:33.608318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1265/2504] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:33.612350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.622890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2941-9a26-4239-ac2c-cb8355c13ba2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.627517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.628179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.628460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.628739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] PATH_INFO: `/v3/projects/91cffcb3c95641d788510123f00d72cb/users/56b61864cf134ec9baaa6caebbf15f2e/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.631832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:33.645284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cffcb3c95641d788510123f00d72cb, user_id=56b61864cf134ec9baaa6caebbf15f2e, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.647878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.660853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1240/2505] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:33 2022] PUT /identity/v3/projects/91cffcb3c95641d788510123f00d72cb/users/56b61864cf134ec9baaa6caebbf15f2e/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:33.664884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.675606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9420-3d41-48bf-8d5b-c7c617dd4fc3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.734107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.734772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.735055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.735332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.736031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.737666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b686ca-52f2-4be3-857b-d0cf29a50692 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.749584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1266/2506] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:33.753449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:33.764251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e91e8-2030-486b-8f45-2d938a2f1409 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:33.769195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:33.769965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:33.770241 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:33.770513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] PATH_INFO: `/v3/projects/91cffcb3c95641d788510123f00d72cb/users/56b61864cf134ec9baaa6caebbf15f2e/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:33.772464 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cffcb3c95641d788510123f00d72cb, user_id=56b61864cf134ec9baaa6caebbf15f2e, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:33.775268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:33.788826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1241/2507] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:33 2022] PUT /identity/v3/projects/91cffcb3c95641d788510123f00d72cb/users/56b61864cf134ec9baaa6caebbf15f2e/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:37.652108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719bf42-a790-41cc-8794-ae397fbfa0e1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:37.652703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719bf42-a790-41cc-8794-ae397fbfa0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:37.652703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719bf42-a790-41cc-8794-ae397fbfa0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:37.693571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3719bf42-a790-41cc-8794-ae397fbfa0e1 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:37.694912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3719bf42-a790-41cc-8794-ae397fbfa0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:37.815826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1267/2508] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 07:01:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:01:37.828958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:37.832033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:37.987003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d31bd-7ccb-4fd4-8c4a-cd3e5ed5aac3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:38.000483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:38.001165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:38.001453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:38.004461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:38.019580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:38.042604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:38.059623 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1242/2509] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 07:01:39.850740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:39.851183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:39.851183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:39.894367 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:39.903913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] MFA Rules not processed for user `56b61864cf134ec9baaa6caebbf15f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:39.905598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:39.990508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7f25-1342-4849-9666-6689f002eff1 service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:39.998356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:39.999201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:39.999576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:39.999854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:40.001786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:40.017055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1268/2510] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:40.031396 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:40.032788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:40.076827 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:40.088854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:40.091016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:40.105117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1243/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:01:40.137739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844d3b0-9f0b-478d-9c22-425def060278 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:40.143692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:40.144343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:40.144622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:40.144894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:40.211603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:40.214272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:40.233218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1269/2512] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:01:45.879228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:45.881348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:45.905882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1edf-6419-4f36-bc4c-7c27ddb07705 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:45.912020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:45.912679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:45.913175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:45.913642 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] PATH_INFO: `/v3/users/4dfe597e0add46df8556475fbd4596df` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:45.914976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfe597e0add46df8556475fbd4596df)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:45.917114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:45.923625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:45.983181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfe597e0add46df8556475fbd4596df'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:45.983945 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfe597e0add46df8556475fbd4596df'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.003460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfe597e0add46df8556475fbd4596df'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.004284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfe597e0add46df8556475fbd4596df'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.026735 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-65de05d6-0076-4ea9-8de4-01a3c2db6641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfe597e0add46df8556475fbd4596df'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.041443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1244/2513] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:01:45 2022] DELETE /identity/v3/users/4dfe597e0add46df8556475fbd4596df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:46.278375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:46.295238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bcbc2-12bb-4282-8e5a-8a45f8b7a603 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:46.406128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:46.406870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.407273 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.407551 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] PATH_INFO: `/v3/projects/93a823c7b6e64be6a57b96cee7551f7f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.408848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a823c7b6e64be6a57b96cee7551f7f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:46.411524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:46.507051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a823c7b6e64be6a57b96cee7551f7f', 'request_id': 'req-da5e765b-028d-4ac7-8625-ced1bb393f32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.517981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a823c7b6e64be6a57b96cee7551f7f', 'request_id': 'req-da5e765b-028d-4ac7-8625-ced1bb393f32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.535077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a823c7b6e64be6a57b96cee7551f7f', 'request_id': 'req-da5e765b-028d-4ac7-8625-ced1bb393f32'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.536452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:46.560777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] The token cache is being invalidate because project 93a823c7b6e64be6a57b96cee7551f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:01:46.561116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.562075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-da5e765b-028d-4ac7-8625-ced1bb393f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:46.564062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1270/2514] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:01:46 2022] DELETE /identity/v3/projects/93a823c7b6e64be6a57b96cee7551f7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:46.569252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.569753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.570340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.605103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:46.606559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:46.724299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1245/2515] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:46.728447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.728447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.728447 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.755692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:46.757603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:46.771875 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1271/2516] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:46.776144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:46.787253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374bf1d-ec6e-4024-8830-7bb9c4730cf0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:46.792514 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:46.793358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.793651 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.793930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.794652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:01:46.794961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:46.796703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:46.811196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1246/2517] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:01:46.815688 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:46.827366 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaa3d-3892-49f8-92d2-c25ecfbd5c8b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:46.832749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:46.833562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.833845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.834119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.834788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:46.836851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:46.875037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1272/2518] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:46 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:46.879089 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:46.891170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeebdd-c828-40bd-9870-12b6e5d413ce admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:46.953657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:46.954086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:46.954368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:46.954645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:46.955385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:46.957383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:46.986750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:46.994275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1247/2519] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:46 2022] POST /identity/v3/users => generated 305 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:01:46.997991 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.009635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f16e-38b7-48bd-9d4e-f753dbcf83a2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.025437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.025437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.025437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.025437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.025777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.025777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.034110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1273/2520] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:47.038700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.052388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a353f-b3da-4f68-8fc6-d183cc89dd45 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.059281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.060131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.060418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.060693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.061457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.063066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62180f17-7ca6-4bc0-9581-2dc38dd50e16 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.074790 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1248/2521] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:01:47.078977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.088595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2107b61-fc77-40dd-96c7-b2e99be419e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.093698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.094626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.094903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.095173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] PATH_INFO: `/v3/projects/390169ef229549c4a3a3bc9bd726e6e6/users/f674700b05b04d0887759a9823221efb/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.115151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=390169ef229549c4a3a3bc9bd726e6e6, user_id=f674700b05b04d0887759a9823221efb, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.118518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.132917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1274/2522] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:47 2022] PUT /identity/v3/projects/390169ef229549c4a3a3bc9bd726e6e6/users/f674700b05b04d0887759a9823221efb/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:47.144502 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.144786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.145349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.174873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] MFA Rules not processed for user `f674700b05b04d0887759a9823221efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:47.176112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:47.252725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1249/2523] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:47.257533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.328115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c5e1-71ef-45c8-bfef-a21d6ac29f6c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.335459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.336109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.336419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.336696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.337571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.339618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.373265 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1275/2524] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:47 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:47.377433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.390062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a00a-1035-4504-a69a-a2c59b0b95fa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.461066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.462022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.462280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.462556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.463222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.466095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.494564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1250/2525] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:47 2022] POST /identity/v3/users => generated 310 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:01:47.498655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.514524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd428e1-a1ba-4010-8630-dc7dae658d6b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.519284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.519906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.520182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.520454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.521168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.523204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.534957 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1276/2526] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:47.540422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.550902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fa13-7017-4fd8-9d3b-229638dfab8e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.555493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.556166 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.556443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.556736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] PATH_INFO: `/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8/users/03acd009e65d4a2ab48430f0332d8f68/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.575364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e2a8b74e34bc39e4e7574668c12d8, user_id=03acd009e65d4a2ab48430f0332d8f68, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.578063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.598291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1251/2527] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:47 2022] PUT /identity/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8/users/03acd009e65d4a2ab48430f0332d8f68/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:01:47.602107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.612820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463464d-44fa-4317-8107-df0de10e7b31 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.681837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.682511 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.682795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.683826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.684354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.686072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be72b-95d0-493d-af8d-4f80c9562ed5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.691622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:47.700390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1277/2528] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:47.705140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.718355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa092-454a-4bd6-93db-4749bca83eea admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.726078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.727359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.727644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.727913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] PATH_INFO: `/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8/users/03acd009e65d4a2ab48430f0332d8f68/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.730566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e2a8b74e34bc39e4e7574668c12d8, user_id=03acd009e65d4a2ab48430f0332d8f68, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.734213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.747006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1252/2529] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:47 2022] PUT /identity/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8/users/03acd009e65d4a2ab48430f0332d8f68/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:47.757603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.758280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.758730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.791389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] MFA Rules not processed for user `03acd009e65d4a2ab48430f0332d8f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:47.793142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:47.874300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1278/2530] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:47.885368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:47.887736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:47.924830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:47.954552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ed5-0f3a-4bf3-b064-4a1d7e55ec76 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:47.961090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:47.961722 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:47.961996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:47.962268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:47.972676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:47.974154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc355c1-4970-439c-88dd-9f35635f87e7 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:47.984801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1253/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:48.170128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:48.172211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:48.185606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08706a2-020a-4209-8053-c9e490d616bb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:48.189212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:48.189899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:48.190245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:48.190582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:48.256811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:48.258310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:48.268306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1279/2532] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:48 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:48.978304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:48.978809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:48.978917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:48.998041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] MFA Rules not processed for user `c03cd88d3da44d0f8b067d9140c225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:48.999308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:49.055696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1254/2533] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:49.375221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:49.376639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:49.441179 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e284b5-93b4-45e4-ba64-f20ef6eea08f service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:49.444760 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:49.445418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:49.445698 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:49.445970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:49.447707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:49.458561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:49.459994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f6ae1-4140-4d9d-9b34-9dac5b0101fd service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:49.469372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1280/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:56.762417 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:56.833830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39226c-3edb-4fea-990d-159616024eb1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:56.838664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:56.839305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:56.839590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:56.839985 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] PATH_INFO: `/v3/users/f674700b05b04d0887759a9823221efb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:56.841236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f674700b05b04d0887759a9823221efb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:56.844053 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:56.894025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f674700b05b04d0887759a9823221efb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:56.894683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f674700b05b04d0887759a9823221efb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:56.901583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f674700b05b04d0887759a9823221efb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:56.902224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f674700b05b04d0887759a9823221efb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:56.915160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f674700b05b04d0887759a9823221efb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:56.924074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:56.930292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1255/2535] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:01:56 2022] DELETE /identity/v3/users/f674700b05b04d0887759a9823221efb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:56.934966 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:56.935645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:56.935645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:56.955086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:56.956293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:56.976912 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:57.016462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1281/2536] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:57.026152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:57.027617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:57.085761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cb26-4b1c-4a15-b53f-49bd80ac70e9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:57.089392 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:57.090014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:57.090296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:57.090572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:57.101192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:57.102629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:57.113088 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1256/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:57.381510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:57.382915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:57.406924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a3d3-bf80-44c3-a3cf-b38e678eaa07 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:57.411679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:57.412329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:57.412604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:57.412872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] PATH_INFO: `/v3/projects/390169ef229549c4a3a3bc9bd726e6e6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:57.414044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390169ef229549c4a3a3bc9bd726e6e6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:57.415911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:57.462761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390169ef229549c4a3a3bc9bd726e6e6', 'request_id': 'req-3a96d652-ad5d-4fc7-87e8-262b965d2b70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.468614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390169ef229549c4a3a3bc9bd726e6e6', 'request_id': 'req-3a96d652-ad5d-4fc7-87e8-262b965d2b70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.475674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390169ef229549c4a3a3bc9bd726e6e6', 'request_id': 'req-3a96d652-ad5d-4fc7-87e8-262b965d2b70'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.487122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] The token cache is being invalidate because project 390169ef229549c4a3a3bc9bd726e6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:01:57.487408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.488034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.489556 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1282/2538] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:01:57 2022] DELETE /identity/v3/projects/390169ef229549c4a3a3bc9bd726e6e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:57.494038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:57.506098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b29a-c906-489c-924c-30e697121f18 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:57.561751 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:57.562396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:57.562678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:57.562955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] PATH_INFO: `/v3/users/03acd009e65d4a2ab48430f0332d8f68` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:57.564144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=03acd009e65d4a2ab48430f0332d8f68)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:57.566109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:57.616240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03acd009e65d4a2ab48430f0332d8f68'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.616900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03acd009e65d4a2ab48430f0332d8f68'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.624585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03acd009e65d4a2ab48430f0332d8f68'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.625181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03acd009e65d4a2ab48430f0332d8f68'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.636829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa35d3ba-c4db-476f-a082-e320011a07ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03acd009e65d4a2ab48430f0332d8f68'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:57.649468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1257/2539] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:01:57 2022] DELETE /identity/v3/users/03acd009e65d4a2ab48430f0332d8f68 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:01:57.994479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:57.995937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:58.009516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96d652-ad5d-4fc7-87e8-262b965d2b70 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.071455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.072088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.072362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.072631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] PATH_INFO: `/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.073794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5e2a8b74e34bc39e4e7574668c12d8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.075669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.120481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5e2a8b74e34bc39e4e7574668c12d8', 'request_id': 'req-595588c2-7cf5-4040-85f2-ace2a9c073d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:58.123402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:58.128033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5e2a8b74e34bc39e4e7574668c12d8', 'request_id': 'req-595588c2-7cf5-4040-85f2-ace2a9c073d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:58.137484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5e2a8b74e34bc39e4e7574668c12d8', 'request_id': 'req-595588c2-7cf5-4040-85f2-ace2a9c073d0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:58.149228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] The token cache is being invalidate because project 4b5e2a8b74e34bc39e4e7574668c12d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:01:58.149542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:58.150167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-595588c2-7cf5-4040-85f2-ace2a9c073d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:01:58.151672 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1283/2540] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:01:57 2022] DELETE /identity/v3/projects/4b5e2a8b74e34bc39e4e7574668c12d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:58.156567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.157056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.157171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.176296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:58.177515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:58.190539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:58.237975 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1258/2541] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:58.245962 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.246249 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.246524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.265951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:58.267123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:58.274813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1284/2542] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:01:58.278969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.288530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf4321-f39c-4b4e-ae44-dd1b837b8fd1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.293083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.293745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.294028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.294298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.295556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:01:58.295856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.297466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.308726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1259/2543] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:01:58.313768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.322781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819db40b-a89b-4e71-94c1-eaf235f071d3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.327506 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.328098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.328375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.328644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.329338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.331208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.358537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1285/2544] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:58.362688 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.372799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76c90-22c3-4370-86ae-9d45a6af3474 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.427862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.428399 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.428681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.428956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.429636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.431546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.452435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1260/2545] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:58.456528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.467224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad3f4-7c98-4913-aaab-e9c997c33a81 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.472905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.473616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.474087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.474452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.475201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.476868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.486886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1286/2546] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:58.490892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.502324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca3e17-d1b9-4120-bddb-f8711593fa3f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.506903 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.507513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.507797 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.508075 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.508760 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.510389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376179b-f1ed-45a9-b435-bdddb08c240d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.521463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1261/2547] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:58.525544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.535759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae87f4-84d2-46de-9407-64e3150333c2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.540280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.540926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.541233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.541504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] PATH_INFO: `/v3/projects/c0389ed0b5e14fa48fc7040bead3ee81/users/43591ab02d5d409b8c03e04b888e38f6/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.556782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0389ed0b5e14fa48fc7040bead3ee81, user_id=43591ab02d5d409b8c03e04b888e38f6, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.559436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.572292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1287/2548] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:58 2022] PUT /identity/v3/projects/c0389ed0b5e14fa48fc7040bead3ee81/users/43591ab02d5d409b8c03e04b888e38f6/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:01:58.584485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2cc2-db6a-473d-b8f9-13915bd95118 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.584769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2cc2-db6a-473d-b8f9-13915bd95118 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.585070 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd2cc2-db6a-473d-b8f9-13915bd95118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.613105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-62fd2cc2-db6a-473d-b8f9-13915bd95118 None None] MFA Rules not processed for user `43591ab02d5d409b8c03e04b888e38f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:58.613894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-62fd2cc2-db6a-473d-b8f9-13915bd95118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:58.681880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1262/2549] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:01:58.686353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.753261 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8682-728a-4263-a62a-f61e63eb70ca admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.758226 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.758876 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.759159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.759436 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.760279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.762271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.787933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.788224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.788500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.793023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1288/2550] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:58.796619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.807886 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] MFA Rules not processed for user `b17a00d68d66412aaddb2235efcc18f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:58.809109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:58.818946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:58.870085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2720-e19a-42e4-bfe9-ec9d4b513d7c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.874658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1263/2551] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:01:58.880733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.881409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.881691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.881964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.882646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.884700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.894617 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:58.913815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1289/2552] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:01:58 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:01:58.916386 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.927877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b112-a2c9-4212-b846-14e5a331fa59 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.934372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.935727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.936997 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.937444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.938454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:58.940383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:58.957049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1264/2553] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:01:58.959039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:58.971104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b38bc-2a6b-4bef-a371-7722c63c803d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:58.977390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:58.978277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:58.978599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:58.978972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] PATH_INFO: `/v3/projects/85724f8125e14a35b3075b7e36ef2854/users/cfa34f64a2474d82a0ae87c6a2ab8de3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:58.996781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85724f8125e14a35b3075b7e36ef2854, user_id=cfa34f64a2474d82a0ae87c6a2ab8de3, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:59.000147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:59.020501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1290/2554] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:58 2022] PUT /identity/v3/projects/85724f8125e14a35b3075b7e36ef2854/users/cfa34f64a2474d82a0ae87c6a2ab8de3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:59.024526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:59.034730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a02ed-f147-462a-9460-7cafb3969cb2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:59.120246 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:59.121013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:59.121576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:59.121856 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:59.122587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:59.124513 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36922a1d-3f0a-4071-87b9-17f0ecf7a7c7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:59.136076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1265/2555] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:01:59.140932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:59.151708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701bb51-a04e-4474-ae04-0c3fa238d494 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:59.157003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:59.157676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:59.157951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:59.158221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] PATH_INFO: `/v3/projects/85724f8125e14a35b3075b7e36ef2854/users/cfa34f64a2474d82a0ae87c6a2ab8de3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:59.160794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85724f8125e14a35b3075b7e36ef2854, user_id=cfa34f64a2474d82a0ae87c6a2ab8de3, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:59.163639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:59.178218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1291/2556] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:01:59 2022] PUT /identity/v3/projects/85724f8125e14a35b3075b7e36ef2854/users/cfa34f64a2474d82a0ae87c6a2ab8de3/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:01:59.190353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:59.190888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:59.190888 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:59.226558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] MFA Rules not processed for user `cfa34f64a2474d82a0ae87c6a2ab8de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:01:59.227782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:59.303228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1266/2557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:01:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:01:59.315159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:59.316878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:59.379759 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab130eaf-ef51-4c52-b409-887a31fd2791 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:59.384163 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:59.384497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:59.384777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:59.385077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:59.394691 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:59.396186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:59.406576 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1292/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:01:59.499509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:01:59.501345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:01:59.513881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7868e4-2239-4a01-aaaf-32234c2ca498 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:01:59.519855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:01:59.520508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:01:59.520784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:01:59.521264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:01:59.554266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:01:59.583081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:01:59.584719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9a09-fb82-4bc3-b1e4-0293b73c38fb service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:01:59.596221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1267/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:01:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:04.468291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:04.543351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77ff9-c299-4e74-8969-e285a040fd40 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:04.552343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:04.553544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:04.553929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:04.554309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] PATH_INFO: `/v3/users/43591ab02d5d409b8c03e04b888e38f6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:04.555696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43591ab02d5d409b8c03e04b888e38f6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:04.557784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:04.618889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43591ab02d5d409b8c03e04b888e38f6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:04.619839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43591ab02d5d409b8c03e04b888e38f6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:04.620523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43591ab02d5d409b8c03e04b888e38f6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:04.629392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43591ab02d5d409b8c03e04b888e38f6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:04.631288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:04.644418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43591ab02d5d409b8c03e04b888e38f6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:04.658298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1293/2560] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:04 2022] DELETE /identity/v3/users/43591ab02d5d409b8c03e04b888e38f6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:04.662689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:04.663221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:04.663221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:04.682884 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:04.684296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:04.753965 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1268/2561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:04.764339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:04.765764 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:04.824548 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5679-e79a-4342-b872-33e096458b07 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:04.828824 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:04.829479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:04.829762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:04.830035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:04.839178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:04.840600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:04.851252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1294/2562] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:05.260474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:05.262009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:05.274394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d52b6-e3ac-4118-a92c-429598e0e76e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:05.279024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:05.279668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:05.279954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:05.280231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] PATH_INFO: `/v3/projects/c0389ed0b5e14fa48fc7040bead3ee81` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:05.281419 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0389ed0b5e14fa48fc7040bead3ee81)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:05.283334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:05.333033 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0389ed0b5e14fa48fc7040bead3ee81', 'request_id': 'req-3736c5a7-a24b-4b80-b956-5f7681198a48'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.348438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0389ed0b5e14fa48fc7040bead3ee81', 'request_id': 'req-3736c5a7-a24b-4b80-b956-5f7681198a48'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.355139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0389ed0b5e14fa48fc7040bead3ee81', 'request_id': 'req-3736c5a7-a24b-4b80-b956-5f7681198a48'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.371057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] The token cache is being invalidate because project c0389ed0b5e14fa48fc7040bead3ee81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:05.371443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.373226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.375394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1269/2563] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:05 2022] DELETE /identity/v3/projects/c0389ed0b5e14fa48fc7040bead3ee81 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:05.379217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:05.383144 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:05.384657 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:05.390268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7406ed2-1ce7-4bca-bea4-ce234cfa5c8b service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:05.441446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:05.463393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:05.464058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:05.464340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:05.464616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] PATH_INFO: `/v3/users/cfa34f64a2474d82a0ae87c6a2ab8de3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:05.466218 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa34f64a2474d82a0ae87c6a2ab8de3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:05.468301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c5a7-a24b-4b80-b956-5f7681198a48 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:05.468570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:05.474744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:05.475520 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:05.475919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:05.476414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:05.478363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:05.492054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:05.494118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:05.508276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1270/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:02:05.523993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa34f64a2474d82a0ae87c6a2ab8de3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.524500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa34f64a2474d82a0ae87c6a2ab8de3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.525157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa34f64a2474d82a0ae87c6a2ab8de3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.533624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa34f64a2474d82a0ae87c6a2ab8de3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.546237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-352a1d73-fdb3-4613-83b5-5ac414bef778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa34f64a2474d82a0ae87c6a2ab8de3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:05.557194 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:05.560810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1295/2565] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:05 2022] DELETE /identity/v3/users/cfa34f64a2474d82a0ae87c6a2ab8de3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:06.013982 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.015498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:06.037397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce49f5-0878-4f20-a1d2-e538599e026f service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.118581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.119252 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.119725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.120009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] PATH_INFO: `/v3/projects/85724f8125e14a35b3075b7e36ef2854` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.121289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85724f8125e14a35b3075b7e36ef2854)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.123803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.195570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85724f8125e14a35b3075b7e36ef2854', 'request_id': 'req-f346711b-68bd-4f64-a0f5-cb6a69163396'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:06.203755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85724f8125e14a35b3075b7e36ef2854', 'request_id': 'req-f346711b-68bd-4f64-a0f5-cb6a69163396'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:06.212062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85724f8125e14a35b3075b7e36ef2854', 'request_id': 'req-f346711b-68bd-4f64-a0f5-cb6a69163396'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:06.231090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] The token cache is being invalidate because project 85724f8125e14a35b3075b7e36ef2854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:06.233011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:06.233780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f346711b-68bd-4f64-a0f5-cb6a69163396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:06.239807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1271/2566] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:06 2022] DELETE /identity/v3/projects/85724f8125e14a35b3075b7e36ef2854 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:06.241677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.242063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.242441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.268842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:06.269973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:06.345255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1296/2567] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:06.355563 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.356303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.357507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.379925 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:06.381162 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:06.389714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1272/2568] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:06.394177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.404792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f5ec8-3bf3-4dfe-9a4c-9396f959a204 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.409427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.410048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.410358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.410783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.411487 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:02:06.411789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.413461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.426816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1297/2569] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:02:06.431350 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.441559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574990ca-5f96-4701-aabd-412c1858a461 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.446300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.446919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.447201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.447475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.448138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.450140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.479610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1273/2570] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:06.484638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.503664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1739-469a-4adb-a4db-3df61d258e38 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.564353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.564905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.565236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.565514 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.566183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.568108 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.597269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1298/2571] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:06.598282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.609445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d07d69-b963-4323-b39d-270f0fc82688 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.614247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.614988 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.615273 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.615550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.616279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.617936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.629016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1274/2572] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:06.632961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.643434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f92f-6287-4bcc-9503-b375f5307910 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.648355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.649094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.649411 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.649669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.650442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.652110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e893e-3f66-467f-9751-7751b2517782 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.663243 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1299/2573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:06.667601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.678911 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13e664-156b-456a-bf10-c7c795808274 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.686957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.687641 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.687923 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.688212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] PATH_INFO: `/v3/projects/14eba644107344d29e65e3f9f6438ebe/users/d8e4bc5688c9433fb7b8c1e941bdd202/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.704758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eba644107344d29e65e3f9f6438ebe, user_id=d8e4bc5688c9433fb7b8c1e941bdd202, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.707536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.721421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1275/2574] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:06 2022] PUT /identity/v3/projects/14eba644107344d29e65e3f9f6438ebe/users/d8e4bc5688c9433fb7b8c1e941bdd202/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:02:06.733438 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.734103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.734394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.773135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] MFA Rules not processed for user `d8e4bc5688c9433fb7b8c1e941bdd202`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:06.774386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:06.829517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:06.840125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1300/2575] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:06.845463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.853185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:06.919726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ac11-ac83-4dd7-a0c4-020bbf203f31 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:06.924592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:06.925232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:06.925529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:06.925788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:06.926451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:06.928334 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:06.954304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1276/2576] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:06.958390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:06.969649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dbe3f-fedb-45e0-89b1-0c9b46fe32e4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.024051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.024664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.024943 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.025247 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.025907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.027807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.053008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1301/2577] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:06 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:02:07.054171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:07.064515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a49f6-6719-4ebb-8655-a1969b1f4daa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.069178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.069805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.070106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.070365 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.071113 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.072781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.083643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1277/2578] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:07.087669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:07.098382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcad55-1a7d-4691-87bb-b3e9947318fd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.102938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.103589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.103872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.104148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] PATH_INFO: `/v3/projects/8c80b63b8688400ebfebfbb18c20db34/users/1bfa2247566e463897d8227ad82ecd4b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.119699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b63b8688400ebfebfbb18c20db34, user_id=1bfa2247566e463897d8227ad82ecd4b, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.122424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.135864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1302/2579] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:07 2022] PUT /identity/v3/projects/8c80b63b8688400ebfebfbb18c20db34/users/1bfa2247566e463897d8227ad82ecd4b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:07.140304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:07.150222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e1c2-3c89-42b5-ae2d-b17b86edb93c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.207749 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.208364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.208636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.208909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.209620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.211196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000ffa1-dba5-48e9-a620-53736af7035d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.221805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1278/2580] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:07.226047 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:07.236067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5a649-777c-4542-8292-e9ef9ec5710f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.240525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.241224 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.241504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.241818 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] PATH_INFO: `/v3/projects/8c80b63b8688400ebfebfbb18c20db34/users/1bfa2247566e463897d8227ad82ecd4b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.243746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b63b8688400ebfebfbb18c20db34, user_id=1bfa2247566e463897d8227ad82ecd4b, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.246402 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.256692 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1303/2581] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:07 2022] PUT /identity/v3/projects/8c80b63b8688400ebfebfbb18c20db34/users/1bfa2247566e463897d8227ad82ecd4b/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:07.267552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.267829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.268100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.295771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] MFA Rules not processed for user `1bfa2247566e463897d8227ad82ecd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:07.297124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:07.364388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:07.368485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1279/2582] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:07.379574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:07.381372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:07.444801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a350-cc85-4adc-8819-9f6a3c7122dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:07.448644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:07.449303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:07.449579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:07.449849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:07.508210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:07.509676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:07.514788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:07.519582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1304/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:11.748593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:11.750839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:11.765305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922768-8ec4-495d-af78-0a15a0e138f9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:11.770042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:11.770164 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:11.770440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:11.770708 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:11.782228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:11.783881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafcf30-628c-44f4-a41c-950b30b95a6a service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:11.795730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1280/2584] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:16.770798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:16.833381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffdc-e2b4-4088-bd64-447ffc2e7bc9 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:16.837789 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:16.838417 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:16.838690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:16.838964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] PATH_INFO: `/v3/users/d8e4bc5688c9433fb7b8c1e941bdd202` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:16.840110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e4bc5688c9433fb7b8c1e941bdd202)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:16.842579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:16.895905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e4bc5688c9433fb7b8c1e941bdd202'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:16.896569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e4bc5688c9433fb7b8c1e941bdd202'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:16.897346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e4bc5688c9433fb7b8c1e941bdd202'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:16.905099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e4bc5688c9433fb7b8c1e941bdd202'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:16.917658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e4bc5688c9433fb7b8c1e941bdd202'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:16.931752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1305/2585] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:16 2022] DELETE /identity/v3/users/d8e4bc5688c9433fb7b8c1e941bdd202 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:16.936280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:16.936816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:16.936924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:16.956671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:16.958086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:17.022862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1281/2586] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:17.033668 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:17.035351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:17.095689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abe0cc-857c-4695-9944-a997375f071d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:17.099241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:17.099853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:17.100127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:17.100394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:17.109210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:17.110626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:17.119840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1306/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:17.409029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:17.410729 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:17.425609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdcf31-609a-46df-8b8b-89324d0d62d0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:17.430311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:17.430966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:17.431288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:17.431587 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] PATH_INFO: `/v3/projects/14eba644107344d29e65e3f9f6438ebe` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:17.432896 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eba644107344d29e65e3f9f6438ebe)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:17.435846 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:17.482883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eba644107344d29e65e3f9f6438ebe', 'request_id': 'req-cfc020e0-6220-4c8e-b528-8da171f40176'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.488189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eba644107344d29e65e3f9f6438ebe', 'request_id': 'req-cfc020e0-6220-4c8e-b528-8da171f40176'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.494524 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eba644107344d29e65e3f9f6438ebe', 'request_id': 'req-cfc020e0-6220-4c8e-b528-8da171f40176'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.508410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] The token cache is being invalidate because project 14eba644107344d29e65e3f9f6438ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:17.508693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.509358 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.510957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1282/2588] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:17 2022] DELETE /identity/v3/projects/14eba644107344d29e65e3f9f6438ebe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:02:17.515849 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:17.525340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f910c-64be-459d-9c07-42ddc2937c36 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:17.543150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:17.582733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:17.583362 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:17.583631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:17.583907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] PATH_INFO: `/v3/users/1bfa2247566e463897d8227ad82ecd4b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:17.585064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfa2247566e463897d8227ad82ecd4b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:17.586961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:17.631800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfa2247566e463897d8227ad82ecd4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.632446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfa2247566e463897d8227ad82ecd4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.633087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfa2247566e463897d8227ad82ecd4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.640472 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfa2247566e463897d8227ad82ecd4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.651969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8aafc5ce-5a2b-483d-902b-753cd0c229cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfa2247566e463897d8227ad82ecd4b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:17.664663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1307/2589] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:17 2022] DELETE /identity/v3/users/1bfa2247566e463897d8227ad82ecd4b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:17.936881 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:17.938592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:17.952290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc020e0-6220-4c8e-b528-8da171f40176 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.017538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.018100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.018635 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.018910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] PATH_INFO: `/v3/projects/8c80b63b8688400ebfebfbb18c20db34` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.020060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c80b63b8688400ebfebfbb18c20db34)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.021994 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.033904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:18.073111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c80b63b8688400ebfebfbb18c20db34', 'request_id': 'req-e9708b94-5403-4bff-a9c5-78c65abf5344'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:18.079622 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c80b63b8688400ebfebfbb18c20db34', 'request_id': 'req-e9708b94-5403-4bff-a9c5-78c65abf5344'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:18.086029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c80b63b8688400ebfebfbb18c20db34', 'request_id': 'req-e9708b94-5403-4bff-a9c5-78c65abf5344'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:18.098841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] The token cache is being invalidate because project 8c80b63b8688400ebfebfbb18c20db34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:18.099224 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:18.099854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e9708b94-5403-4bff-a9c5-78c65abf5344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:18.105069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1283/2590] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:17 2022] DELETE /identity/v3/projects/8c80b63b8688400ebfebfbb18c20db34 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:18.108520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.109034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.109130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.128294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:18.129523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.190983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1308/2591] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:18.199546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.199873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.200355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.222234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:18.223443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.232553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1284/2592] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:18.236911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.246297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911131bb-5c08-4a44-9d3a-f1b6a904c260 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.251602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.252215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.252496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.252768 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.253488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:02:18.253851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.255439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.267767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1309/2593] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 07:02:18.272285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.282705 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c75f1a-f9bc-4f60-b19f-3a6bb058d02a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.288007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.289278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.289565 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.290052 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.290719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.292618 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.321806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1285/2594] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:18 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:18.326019 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.335976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd519-13b2-464d-bc52-72b58451e27c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.348443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.350168 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.372287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:18.407001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.407629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.407909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.408182 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.408458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4edc8e-fc43-471f-a894-56da9158e52b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.408836 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.410813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.412192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.412806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.413128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.413430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.415176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.436809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1310/2595] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:18 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:18.437860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.447659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b959b-f359-4b0e-94cb-525ecdfe2438 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.454267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.454868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.455148 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.455423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.456135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.458160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.470371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1311/2596] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:18.475445 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.486763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.488237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.493350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc4f4a-757c-49cd-a87d-04bf7843aea9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.499835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1286/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:02:18.500185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.501001 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.501415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.501830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.502583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.504190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3460-dd56-4596-8f60-c89f8193254b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.515778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1312/2598] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:18.520087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.531835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaa9d-4ff9-48ac-a25c-0131bfe2a274 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.536957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.537663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.537948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.538226 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] PATH_INFO: `/v3/projects/9fe3b7d7a3424d6f9fa50fcbcc3331aa/users/64309a3ebaec49b1b4d701153d80e463/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.554609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe3b7d7a3424d6f9fa50fcbcc3331aa, user_id=64309a3ebaec49b1b4d701153d80e463, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.557299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.566625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:18.572721 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1287/2599] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:18 2022] PUT /identity/v3/projects/9fe3b7d7a3424d6f9fa50fcbcc3331aa/users/64309a3ebaec49b1b4d701153d80e463/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:18.587911 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.588197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.588480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.618007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] MFA Rules not processed for user `64309a3ebaec49b1b4d701153d80e463`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:18.619258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.685889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1313/2600] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:18.697068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:18.698887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:18.885766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149b19-571c-4601-8a3e-666008160490 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:18.890653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:18.891335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:18.891609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:18.891879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:18.900653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:18.902118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496db5a-8a63-41f7-81ff-693c9d3aa8f1 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:18.912060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1288/2601] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:27.451679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:27.513387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02797e8d-1eda-4dc2-ac73-9cf0952ed96b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:27.517801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:27.518435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:27.518713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:27.518986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] PATH_INFO: `/v3/users/64309a3ebaec49b1b4d701153d80e463` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:27.520129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64309a3ebaec49b1b4d701153d80e463)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:27.522062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:27.556563 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:27.575539 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64309a3ebaec49b1b4d701153d80e463'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:27.576200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64309a3ebaec49b1b4d701153d80e463'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:27.576809 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64309a3ebaec49b1b4d701153d80e463'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:27.583674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64309a3ebaec49b1b4d701153d80e463'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:27.595716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64309a3ebaec49b1b4d701153d80e463'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:27.609067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1314/2602] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:27 2022] DELETE /identity/v3/users/64309a3ebaec49b1b4d701153d80e463 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:27.613690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:27.614201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:27.614201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:27.633544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:27.634739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:27.695364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1289/2603] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:27.705464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:27.707017 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:27.765869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b400d-8915-4ed9-aeb7-728eab53c145 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:27.769486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:27.770196 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:27.770475 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:27.770839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:27.781054 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:27.782538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77d332-196a-4bde-8b7e-bfaa7d033bbe service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:27.792414 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1315/2604] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:28.063340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.064745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:28.081468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dea2e-067c-4873-b2c6-88db23ff82a8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.086063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.086703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.086978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.087290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] PATH_INFO: `/v3/projects/9fe3b7d7a3424d6f9fa50fcbcc3331aa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.088368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe3b7d7a3424d6f9fa50fcbcc3331aa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.090767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.136926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe3b7d7a3424d6f9fa50fcbcc3331aa', 'request_id': 'req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:28.142517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe3b7d7a3424d6f9fa50fcbcc3331aa', 'request_id': 'req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:28.148723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe3b7d7a3424d6f9fa50fcbcc3331aa', 'request_id': 'req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:28.162305 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] The token cache is being invalidate because project 9fe3b7d7a3424d6f9fa50fcbcc3331aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:28.162589 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:28.163208 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-24ede6e2-0613-44b5-b66b-2ec27c1daaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:28.164706 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1290/2605] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:28 2022] DELETE /identity/v3/projects/9fe3b7d7a3424d6f9fa50fcbcc3331aa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:28.170391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.170679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.170955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.190025 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:28.191216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:28.248070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1316/2606] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:28.257086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327b91-7639-4260-b4df-867374a87462 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.257375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327b91-7639-4260-b4df-867374a87462 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.257650 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327b91-7639-4260-b4df-867374a87462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.278389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-47327b91-7639-4260-b4df-867374a87462 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:28.279584 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-47327b91-7639-4260-b4df-867374a87462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:28.287433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1291/2607] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:28.291651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.301477 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8825bc-caac-49da-90dc-2e6fd1bfc2b7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.306129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.306708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.306986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.307253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.307935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:02:28.308234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.309886 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.321132 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1317/2608] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:02:28.325815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327b91-7639-4260-b4df-867374a87462 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.334791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327b91-7639-4260-b4df-867374a87462 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.339427 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.340096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.340863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.341247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.341897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.344027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.359423 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:28.372731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1292/2609] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:28 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:28.377046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.386802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f13e7f-a6d8-4fc8-b424-84383a639996 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.418770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:28.444228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.444844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.445158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.445432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.446080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.447960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.472607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1318/2610] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:28 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:28.476799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.487221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48192-9eb7-4df3-9d40-7fef6459be65 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.492343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.492958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.493263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.493533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.494336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.495953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.511383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1293/2611] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:28.513353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.526293 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e053b-3d6f-4a67-a1a7-d563e9e7ceda admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.536277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.537060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.537345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.537618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.538317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.539914 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780dd5a-3f48-45f2-8a51-006a69043575 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.550429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1319/2612] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:28.554700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.570116 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d601-7edd-441c-b53d-0157375ff4f6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.575323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.576079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.576355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.576640 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] PATH_INFO: `/v3/projects/4a8ee6d7e6ba47ddaec90c55b7128180/users/10d6e0a050ed4aba9d3b66be9f22848e/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.591715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8ee6d7e6ba47ddaec90c55b7128180, user_id=10d6e0a050ed4aba9d3b66be9f22848e, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.594656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.608581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1294/2613] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:28 2022] PUT /identity/v3/projects/4a8ee6d7e6ba47ddaec90c55b7128180/users/10d6e0a050ed4aba9d3b66be9f22848e/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:28.620121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.620121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.620121 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.651910 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] MFA Rules not processed for user `10d6e0a050ed4aba9d3b66be9f22848e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:28.653201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:28.719454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1320/2614] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:28.731366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:28.733112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:28.791245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271798-2f06-486b-b8da-33f6f3dc8fbf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:28.795066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:28.795679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:28.795959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:28.796236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:28.804448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:28.805915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:28.815299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1295/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:29.783757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:29.785161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:29.844075 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4da678-0e82-4344-91a9-10c026b34c11 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:29.847696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:29.848318 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:29.848597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:29.848872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:29.850663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:29.912154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:29.917502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:29.919403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:29.929455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1321/2616] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:33.191817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:33.193943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:33.210690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e81d5-56fd-44cd-b424-371ed7610b3b service glance] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:33.216453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:33.217459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.217750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.218353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] PATH_INFO: `/v3/users/36ce2b6904ef4be4bea04cebcc2a5aaf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.220256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ce2b6904ef4be4bea04cebcc2a5aaf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:33.222235 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:33.277158 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ce2b6904ef4be4bea04cebcc2a5aaf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.278426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ce2b6904ef4be4bea04cebcc2a5aaf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.286064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ce2b6904ef4be4bea04cebcc2a5aaf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.286795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ce2b6904ef4be4bea04cebcc2a5aaf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.307351 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f6111057-dd1d-43e9-9ec7-b780c8e19f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ce2b6904ef4be4bea04cebcc2a5aaf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.321914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1296/2617] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:33 2022] DELETE /identity/v3/users/36ce2b6904ef4be4bea04cebcc2a5aaf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:33.510658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:33.528483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154761c-2e32-44a5-85fe-55226fa72c1d service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:33.592114 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:33.592754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.593069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.593348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] PATH_INFO: `/v3/projects/73dc6a0186a04e20a9a242e600a448fa` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.594803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dc6a0186a04e20a9a242e600a448fa)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:33.596614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:33.643027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dc6a0186a04e20a9a242e600a448fa', 'request_id': 'req-490d8a64-b904-47bb-bfcb-09c04280275f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.648290 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dc6a0186a04e20a9a242e600a448fa', 'request_id': 'req-490d8a64-b904-47bb-bfcb-09c04280275f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.655214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dc6a0186a04e20a9a242e600a448fa', 'request_id': 'req-490d8a64-b904-47bb-bfcb-09c04280275f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.665988 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] The token cache is being invalidate because project 73dc6a0186a04e20a9a242e600a448fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:33.666268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.666893 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-490d8a64-b904-47bb-bfcb-09c04280275f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:33.668907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1322/2618] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:33 2022] DELETE /identity/v3/projects/73dc6a0186a04e20a9a242e600a448fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:33.674359 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.674608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.674850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.698047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:33.699320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:33.728665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:33.761890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1297/2619] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:33.770845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.771157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.771464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.791518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:33.792755 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:33.801838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1323/2620] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:33.806025 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:33.816364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abb025-e367-48b0-b3f5-ec8292e4c828 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:33.821929 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:33.822556 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.822833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.823183 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.824090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:02:33.824562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:33.826659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:33.839479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1298/2621] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 07:02:33.844592 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:33.854220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205685f3-f2f1-4d43-b947-cc435c3958ea None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:33.859473 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:33.860080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.860357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.860626 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.861304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:33.863168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:33.889979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1324/2622] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:33 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:33.895011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:33.907569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a35c6-d8f6-43b6-a035-1d081b65767a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:33.962287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:33.962891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:33.963165 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:33.963433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:33.964121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:33.967233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:33.994444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1299/2623] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:33 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:33.995513 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:34.005696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd8b8b-7a13-482c-8206-195ed64bb024 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:34.010253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:34.010853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:34.011129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:34.011397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:34.012101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:34.013734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:34.023296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1325/2624] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:02:34.027190 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:34.037686 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44eb60-be78-48e5-91e8-801f4b0c838d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:34.042526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:34.044036 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:34.044486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:34.044766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:34.045497 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:34.047295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622422a-1199-41a9-8cdc-e1321cd0f7c0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:34.058891 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1300/2625] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:34.063440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:34.073612 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a1997-dfed-4de1-9680-8b45f70a1b4f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:34.078778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:34.079437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:34.079713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:34.080010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] PATH_INFO: `/v3/projects/9e3fd12cd57b47cfa4ef21df9cf4d5a9/users/3e382103f58f4fed84fe67795926c74c/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:34.094933 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3fd12cd57b47cfa4ef21df9cf4d5a9, user_id=3e382103f58f4fed84fe67795926c74c, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:34.097590 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:34.110877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1326/2626] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:34 2022] PUT /identity/v3/projects/9e3fd12cd57b47cfa4ef21df9cf4d5a9/users/3e382103f58f4fed84fe67795926c74c/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:34.116011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca3bf-120b-4c18-a594-c8e225fad855 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:34.116324 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca3bf-120b-4c18-a594-c8e225fad855 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:34.116602 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca3bf-120b-4c18-a594-c8e225fad855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:34.136030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2f0ca3bf-120b-4c18-a594-c8e225fad855 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:34.137501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2f0ca3bf-120b-4c18-a594-c8e225fad855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:34.196974 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1301/2627] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:34.207858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:34.209823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:34.235267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:34.272165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f76e-8ea0-4498-bc5a-23c18e2a7e1c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:34.275701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:34.276315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:34.276595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:34.276868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:34.286213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:34.287805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:34.299646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1327/2628] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:38.290712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23ae2-0c38-4049-a8ea-e886ece1dee7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:38.291255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23ae2-0c38-4049-a8ea-e886ece1dee7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:38.291255 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23ae2-0c38-4049-a8ea-e886ece1dee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:38.329493 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e4d23ae2-0c38-4049-a8ea-e886ece1dee7 None None] MFA Rules not processed for user `3e382103f58f4fed84fe67795926c74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:38.332827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e4d23ae2-0c38-4049-a8ea-e886ece1dee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:38.374344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:38.425197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1302/2629] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:38.440870 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:38.442375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:38.553577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71f62a-e0b5-4c3d-94c7-9ce74c7068df service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:38.560089 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:38.561084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:38.561084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:38.561334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:38.570071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:38.571799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:38.582800 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1328/2630] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:39.885904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:39.886377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:39.887343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:39.912353 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] MFA Rules not processed for user `3e382103f58f4fed84fe67795926c74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:39.913892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:39.926763 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1303/2631] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:43.571520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:43.583403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3690a-5309-4ff8-995c-3ae4b54b486b service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:43.588861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:43.589532 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:43.589811 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:43.590084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:43.591823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:43.651449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:43.653555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78794e2-7277-4308-9cab-208d6547d61f service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:43.662681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1329/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:49.906009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=16 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:53.658382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=79 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:54.725173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:54.726626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:54.740667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf30fbc-3f20-4d82-bfa6-6353a1ec7555 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:54.745317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:54.746553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:54.746827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:54.747099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] PATH_INFO: `/v3/users/10d6e0a050ed4aba9d3b66be9f22848e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:54.748375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d6e0a050ed4aba9d3b66be9f22848e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:54.750349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:54.801671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d6e0a050ed4aba9d3b66be9f22848e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:54.802318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d6e0a050ed4aba9d3b66be9f22848e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:54.810571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d6e0a050ed4aba9d3b66be9f22848e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:54.811234 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d6e0a050ed4aba9d3b66be9f22848e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:54.823244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d6e0a050ed4aba9d3b66be9f22848e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:54.836696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1304/2633] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:02:54 2022] DELETE /identity/v3/users/10d6e0a050ed4aba9d3b66be9f22848e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:02:54.841767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:54.842271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:54.842368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:54.862418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:54.863602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:54.924088 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1330/2634] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:54.934663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:54.936096 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:54.992239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8715-d804-4df3-95cc-6f6801324584 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:54.996680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:54.997318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:54.997599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:54.997905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.006887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.008300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321a227-2c71-40da-ad95-d5dd4bf62001 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.018485 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1305/2635] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:55.286654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.288213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:55.300996 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c2db8-7f13-4706-bbd2-07355628b841 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.305877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.306526 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.306812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.307094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] PATH_INFO: `/v3/projects/4a8ee6d7e6ba47ddaec90c55b7128180` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.309012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8ee6d7e6ba47ddaec90c55b7128180)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.312069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.360214 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8ee6d7e6ba47ddaec90c55b7128180', 'request_id': 'req-bb13ddec-895a-4915-876c-6b0177876856'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:55.365715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8ee6d7e6ba47ddaec90c55b7128180', 'request_id': 'req-bb13ddec-895a-4915-876c-6b0177876856'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:55.373771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8ee6d7e6ba47ddaec90c55b7128180', 'request_id': 'req-bb13ddec-895a-4915-876c-6b0177876856'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:55.384860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] The token cache is being invalidate because project 4a8ee6d7e6ba47ddaec90c55b7128180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:02:55.385176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:55.385843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bb13ddec-895a-4915-876c-6b0177876856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:02:55.387582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1331/2636] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:02:55 2022] DELETE /identity/v3/projects/4a8ee6d7e6ba47ddaec90c55b7128180 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:02:55.392457 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.392745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.393042 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.413264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:55.414466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:55.473491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1306/2637] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:55.482902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.483187 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.483460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.503335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:55.504530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:55.512425 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1332/2638] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:55.516765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.527331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b681cf0-c194-4196-bb36-57524bf4208e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.532146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.532767 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.533087 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.533361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.534132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:02:55.534431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.536100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.552613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1307/2639] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:02:55.553752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.563583 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0775-857d-4e75-82c7-5234b967a990 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.568241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.569238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.569501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.569766 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.570422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.572285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.605105 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1333/2640] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:02:55 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:55.607282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.613098 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:55.618731 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8a0e-0c78-4c06-88a1-cd6d9a9c4432 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.680570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.681227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.681507 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.681777 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.682434 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.684370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.707163 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1308/2641] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:02:55 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:02:55.711488 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.723769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a16-0505-4caf-bcaa-e4e6efa7611c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.728461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.729167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.729498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.730416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.731113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.732673 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.743062 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1334/2642] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:02:55.747187 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.757572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949c2f-0205-4c2b-b7d6-e2b7e569dfd4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.762062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.762744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.762942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.763195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.763869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.765562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0407ef4-2e49-4808-85b5-dc06eca9cf53 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.778550 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1309/2643] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:02:55.782407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:55.793968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb578bee-ced6-4a5e-9eb4-55045b4d5d60 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:55.798597 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:55.799288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.799574 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.799855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] PATH_INFO: `/v3/projects/4f30d5e271de4514845f8238f6609d26/users/18ebe481c6fe4745a77ee1180028e7c1/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.814859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f30d5e271de4514845f8238f6609d26, user_id=18ebe481c6fe4745a77ee1180028e7c1, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:55.817616 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:55.830964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1335/2644] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:02:55 2022] PUT /identity/v3/projects/4f30d5e271de4514845f8238f6609d26/users/18ebe481c6fe4745a77ee1180028e7c1/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:02:55.897713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193d1-675e-4317-b7b9-afef2b96b13f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:55.897995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193d1-675e-4317-b7b9-afef2b96b13f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:55.898272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193d1-675e-4317-b7b9-afef2b96b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:55.930400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1a6193d1-675e-4317-b7b9-afef2b96b13f None None] MFA Rules not processed for user `18ebe481c6fe4745a77ee1180028e7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:55.931038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1a6193d1-675e-4317-b7b9-afef2b96b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:56.011401 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1310/2645] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:02:56.022234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:02:56.023998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:56.046607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:02:56.083210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371ced6-0432-471c-aaae-b72fe3475c92 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:02:56.086892 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:02:56.087509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:56.087792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:56.088066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:56.097397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:02:56.098851 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:02:56.107611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1336/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:02:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:02:57.460759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:02:57.461371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:02:57.461371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:02:57.481323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] MFA Rules not processed for user `18ebe481c6fe4745a77ee1180028e7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:02:57.482528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:02:57.489373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1311/2647] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:02:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:06.103517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=17 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:07.477117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:10.053430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:10.054865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:10.141441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8502fc-9ef9-48a5-9599-6fd84c5010cb service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:10.146903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:10.147641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:10.147953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:10.148277 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:10.150471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:10.212415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:10.214784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:10.225091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1337/2648] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:15.568178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:15.578459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee24cb-a7f6-40e4-87ea-c1b8ff6dc986 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:15.581950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:15.582551 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:15.582824 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:15.583090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:15.584795 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:15.646665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:15.648094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d171f8f-2f42-45dc-966c-86eae6a08bf8 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:15.658171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1312/2649] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:16.374784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:16.383569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2be3-64d8-44d7-98af-c8c42b7c34b1 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:16.388120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:16.388775 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:16.389084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:16.389365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:16.391376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:16.405637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:16.407216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:16.418657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1338/2650] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:20.135195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:20.136348 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:20.136694 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:20.158231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:20.159796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:20.237859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1313/2651] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 07:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:20.361291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:20.364598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:20.535650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ec5bf-0f8e-4548-9454-299d24fab630 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:20.541304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:20.541953 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:20.542234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:20.542508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:20.554222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:20.556122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4840f-9797-41cb-986e-c9346b3cad1a service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:20.566376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1339/2652] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 07:03:21.040471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:21.042204 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.080403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748cf2-7b79-4c3b-ae66-fa97d3770f26 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:21.086624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:21.088388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.088573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.088950 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] PATH_INFO: `/v3/users/c03cd88d3da44d0f8b067d9140c225bc` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.090525 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03cd88d3da44d0f8b067d9140c225bc)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:21.092689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:21.161893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03cd88d3da44d0f8b067d9140c225bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.162592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03cd88d3da44d0f8b067d9140c225bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.172813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03cd88d3da44d0f8b067d9140c225bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.173693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03cd88d3da44d0f8b067d9140c225bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.195132 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03cd88d3da44d0f8b067d9140c225bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.220469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1314/2653] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:21 2022] DELETE /identity/v3/users/c03cd88d3da44d0f8b067d9140c225bc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:21.396146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.396729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.396729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.427611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:21.428847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.458902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:21.460444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.484948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:21.491139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:21.536479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1340/2654] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 07:03:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:21.544814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:21.546762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.605845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbd27-0630-4867-8630-f17c003da376 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:21.613296 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:21.614593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.614898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.615583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] PATH_INFO: `/v3/projects/58b58385712b4b85871073c41ba79d5f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.617302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b58385712b4b85871073c41ba79d5f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:21.621376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:21.690063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b22a0e-43a3-41ae-b7fe-d6b1c9c77bd4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:21.707182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b58385712b4b85871073c41ba79d5f', 'request_id': 'req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.714700 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b58385712b4b85871073c41ba79d5f', 'request_id': 'req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.726342 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b58385712b4b85871073c41ba79d5f', 'request_id': 'req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.747637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] The token cache is being invalidate because project 58b58385712b4b85871073c41ba79d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:21.748174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.753456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb55c78b-5ed0-4c22-967e-eb1e12f847b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:21.757240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1315/2655] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:21 2022] DELETE /identity/v3/projects/58b58385712b4b85871073c41ba79d5f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:03:21.762617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b34e-57ae-4b90-a79c-2624b829ca27 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.762906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b34e-57ae-4b90-a79c-2624b829ca27 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.763181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b34e-57ae-4b90-a79c-2624b829ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.789334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:21.789973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.790255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.790533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.792946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.794308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e782b34e-57ae-4b90-a79c-2624b829ca27 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:21.795610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e782b34e-57ae-4b90-a79c-2624b829ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.875502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:21.878569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:21.890606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1316/2656] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:03:21.893604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1341/2657] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 07:03:21.902719 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.903040 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.903320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.937780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:21.938871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:21.948740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1317/2658] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:21.954080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:21.972711 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e598d3-14f3-4d51-ac9b-36a65902d7b6 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:21.977745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:21.978419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:21.979069 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:21.979400 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:21.980099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:21.980569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:21.983268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:21.998159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1342/2659] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 07:03:22.002900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.013645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c14f-5b3a-451f-b866-f3eab5ad9521 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.020603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.021279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.021597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.022016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.023479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.026564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432f216-2ec9-4049-92ab-f9df53d67de7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.069009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1318/2660] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:22 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:22.070585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.085873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e246-e2b1-4fa7-a926-41f1c36a6967 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.092643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:22.152756 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.153421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.153702 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.153975 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.154645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.156622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.172199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.173413 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.173912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.186350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1343/2661] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:22 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:03:22.190669 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.196335 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:22.199599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:22.202046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca97f-4d18-413f-8b3f-0b49d2722717 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.206866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.207492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.207801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.208076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.208772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.209503 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:22.210462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.225646 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1344/2662] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:03:22.230831 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.241263 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142a046-d6e5-4cc8-822e-eea43c895716 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.247381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.248165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.248778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.249092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.249802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.251391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.262874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1345/2663] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:22.267530 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.276914 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1319/2664] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 07:03:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:22.282961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e89d-8311-40de-802f-74614054b6a9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.289788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.290928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.291175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.291649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.292023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] PATH_INFO: `/v3/projects/d7ccfb4712c648458ca5d611a075af23/users/57dcdde705794d96a70fb89e44016fb8/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.292134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:22.310522 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ccfb4712c648458ca5d611a075af23, user_id=57dcdde705794d96a70fb89e44016fb8, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.313312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aea45-937e-42d8-946c-3128007bed3c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.329289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1346/2665] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:22 2022] PUT /identity/v3/projects/d7ccfb4712c648458ca5d611a075af23/users/57dcdde705794d96a70fb89e44016fb8/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:22.340448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.340858 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.341030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.394465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] MFA Rules not processed for user `57dcdde705794d96a70fb89e44016fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:22.395901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:22.412500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cc15b-d3f7-43d1-a050-71a9d90114c3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.482189 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1347/2666] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:03:22.489279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:22.490725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:22.505449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.505740 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.506198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.506465 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.549455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:22.578800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.580613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fe826-19df-46fe-9f87-3f7d855df352 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.591375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d7063-4599-4359-890e-e67b5d56cb85 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:22.593479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1320/2667] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 07:03:22.599854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:22.600498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:22.600777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:22.601104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:22.611241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:22.612844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:22.623469 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1348/2668] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:03:23.026819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:23.028329 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:23.028878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:23.041481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:23.060056 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:23.061443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:23.070981 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1321/2669] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 07:03:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:23.088639 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:23.106221 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c8754-b4d3-4802-b844-aef8329261f2 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:23.112697 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:23.113657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:23.113938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:23.114213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:23.123750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:23.125390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dd9f2-8716-4047-8ea0-3e0c6bd14144 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:23.134715 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1349/2670] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:03:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 07:03:25.444662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:25.446409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:25.539917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f0b94-8028-4ee6-b9ba-fa1755a128ba None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:25.550704 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:25.551907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:25.553203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:25.553956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] PATH_INFO: `/v3/users/18ebe481c6fe4745a77ee1180028e7c1` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:25.555511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ebe481c6fe4745a77ee1180028e7c1)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:25.558986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:25.663280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ebe481c6fe4745a77ee1180028e7c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.663986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ebe481c6fe4745a77ee1180028e7c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.672488 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ebe481c6fe4745a77ee1180028e7c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.673275 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ebe481c6fe4745a77ee1180028e7c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.693125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ebe481c6fe4745a77ee1180028e7c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.709003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1322/2671] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:25 2022] DELETE /identity/v3/users/18ebe481c6fe4745a77ee1180028e7c1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:25.714100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:25.714468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:25.714671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:25.736250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:25.737510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:25.801952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:25.803943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:25.809449 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1350/2672] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:25.819020 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527411-e1e4-4312-9752-9fd62fea278b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:25.819169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:25.820609 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:25.824572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:25.825277 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:25.825554 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:25.825825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] PATH_INFO: `/v3/users/25435bfe949540b98325f6cd0945cb7d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:25.827138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25435bfe949540b98325f6cd0945cb7d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:25.829083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:25.881315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b6f5-f85c-401a-b3b3-ada030e9d954 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:25.881654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25435bfe949540b98325f6cd0945cb7d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.882394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25435bfe949540b98325f6cd0945cb7d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.887342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:25.887979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:25.888258 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:25.888534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:25.890360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:25.890788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25435bfe949540b98325f6cd0945cb7d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.891482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25435bfe949540b98325f6cd0945cb7d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.902690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:25.903299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:25.904825 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:25.905298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25435bfe949540b98325f6cd0945cb7d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:25.917099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1351/2673] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:03:25.922157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1323/2674] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:25 2022] DELETE /identity/v3/users/25435bfe949540b98325f6cd0945cb7d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:26.107648 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:26.109895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:26.124698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:26.127103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:26.137301 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964ad1e-26b4-48f8-8fa9-faa4ca680659 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:26.197959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:26.206862 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:26.207508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:26.207792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:26.208063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] PATH_INFO: `/v3/projects/4f30d5e271de4514845f8238f6609d26` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:26.209240 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f30d5e271de4514845f8238f6609d26)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:26.211129 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:26.220330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8b0ad-a885-4e37-b32c-d1e0b96ba35b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:26.225206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:26.225963 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:26.226364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:26.226707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] PATH_INFO: `/v3/projects/e842e3915ee840a3b98723ac207bc8b3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:26.228078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e842e3915ee840a3b98723ac207bc8b3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:26.230154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:26.260126 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f30d5e271de4514845f8238f6609d26', 'request_id': 'req-f09435e7-f25c-4d83-ab58-464c6af5f8f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.266116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f30d5e271de4514845f8238f6609d26', 'request_id': 'req-f09435e7-f25c-4d83-ab58-464c6af5f8f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.273761 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f30d5e271de4514845f8238f6609d26', 'request_id': 'req-f09435e7-f25c-4d83-ab58-464c6af5f8f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.280139 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e842e3915ee840a3b98723ac207bc8b3', 'request_id': 'req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.285726 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e842e3915ee840a3b98723ac207bc8b3', 'request_id': 'req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.286330 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] The token cache is being invalidate because project 4f30d5e271de4514845f8238f6609d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:26.286624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.287278 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.289068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1352/2675] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:26 2022] DELETE /identity/v3/projects/4f30d5e271de4514845f8238f6609d26 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:26.292298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e842e3915ee840a3b98723ac207bc8b3', 'request_id': 'req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.307619 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] The token cache is being invalidate because project e842e3915ee840a3b98723ac207bc8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:26.308045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.308864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.310802 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1324/2676] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:26 2022] DELETE /identity/v3/projects/e842e3915ee840a3b98723ac207bc8b3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:26.315086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:26.316543 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:26.403509 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09435e7-f25c-4d83-ab58-464c6af5f8f2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:26.476347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:26.476956 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:26.477275 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:26.477704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] PATH_INFO: `/v3/users/f2d8fa2bc46b4092b93735d123c13233` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:26.479780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d8fa2bc46b4092b93735d123c13233)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:26.482100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:26.530978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:26.543173 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d8fa2bc46b4092b93735d123c13233'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.544027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d8fa2bc46b4092b93735d123c13233'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.544664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d8fa2bc46b4092b93735d123c13233'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.552593 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d8fa2bc46b4092b93735d123c13233'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.565600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d8fa2bc46b4092b93735d123c13233'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.579160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1353/2677] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:26 2022] DELETE /identity/v3/users/f2d8fa2bc46b4092b93735d123c13233 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:26.769339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:26.770828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:26.784228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb57b-6c3c-48bc-b4d3-bbdef70fabc0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:26.851270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:26.851920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:26.852201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:26.852477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] PATH_INFO: `/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:26.853673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cb70981e6d4bb0a2f2a6b3d3caf8a7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:26.855656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:26.878374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:26.905509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cb70981e6d4bb0a2f2a6b3d3caf8a7', 'request_id': 'req-cd2898db-7d10-40c3-8634-3b71afb34e62'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.910928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cb70981e6d4bb0a2f2a6b3d3caf8a7', 'request_id': 'req-cd2898db-7d10-40c3-8634-3b71afb34e62'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.917126 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cb70981e6d4bb0a2f2a6b3d3caf8a7', 'request_id': 'req-cd2898db-7d10-40c3-8634-3b71afb34e62'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.929479 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] The token cache is being invalidate because project 55cb70981e6d4bb0a2f2a6b3d3caf8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:26.929764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.930379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-cd2898db-7d10-40c3-8634-3b71afb34e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:26.933054 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1325/2678] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:26 2022] DELETE /identity/v3/projects/55cb70981e6d4bb0a2f2a6b3d3caf8a7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:30.138418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:30.138418 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.151664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b103-4365-403d-96a0-3a2f0ab04b43 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:30.206837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:30.207504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.207787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.208066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] PATH_INFO: `/v3/users/57dcdde705794d96a70fb89e44016fb8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.209245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57dcdde705794d96a70fb89e44016fb8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:30.211155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:30.255645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dcdde705794d96a70fb89e44016fb8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.256288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dcdde705794d96a70fb89e44016fb8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.257172 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dcdde705794d96a70fb89e44016fb8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.264754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dcdde705794d96a70fb89e44016fb8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.276942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dcdde705794d96a70fb89e44016fb8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.290160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1354/2679] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:30 2022] DELETE /identity/v3/users/57dcdde705794d96a70fb89e44016fb8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:30.294755 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38794d-913d-4737-a475-7172afb92469 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.295244 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38794d-913d-4737-a475-7172afb92469 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.295349 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38794d-913d-4737-a475-7172afb92469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.313818 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9e38794d-913d-4737-a475-7172afb92469 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:30.315102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e38794d-913d-4737-a475-7172afb92469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.374498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1326/2680] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:30.384663 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:30.386130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.420788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:30.445424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b01d2-07c4-471e-90e3-c86b9a124e54 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:30.449738 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:30.451011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.451011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.451011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.460018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:30.461482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae81e-b3a1-467c-9d86-ea8cc804a69e service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:30.471166 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1355/2681] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:30.750806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38794d-913d-4737-a475-7172afb92469 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:30.753160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e38794d-913d-4737-a475-7172afb92469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.772535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38794d-913d-4737-a475-7172afb92469 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:30.778570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:30.779398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.779816 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.780203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] PATH_INFO: `/v3/projects/d7ccfb4712c648458ca5d611a075af23` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.782013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ccfb4712c648458ca5d611a075af23)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:30.784892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:30.835115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ccfb4712c648458ca5d611a075af23', 'request_id': 'req-b8fc218f-89e1-407e-8882-b89975bde488'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.841200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ccfb4712c648458ca5d611a075af23', 'request_id': 'req-b8fc218f-89e1-407e-8882-b89975bde488'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.847568 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ccfb4712c648458ca5d611a075af23', 'request_id': 'req-b8fc218f-89e1-407e-8882-b89975bde488'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.860784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] The token cache is being invalidate because project d7ccfb4712c648458ca5d611a075af23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:30.861111 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.861723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b8fc218f-89e1-407e-8882-b89975bde488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:30.863249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1327/2682] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:30 2022] DELETE /identity/v3/projects/d7ccfb4712c648458ca5d611a075af23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:30.868176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.869077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.869361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.888621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:30.889865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.948846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1356/2683] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:30.957919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:30.958251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:30.958515 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:30.980108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:30.981445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:30.989872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1328/2684] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:30.995267 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.006607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6768-9a56-40af-80f2-ac21b2f84341 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.011696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.012355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.012638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.012964 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.013727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:31.014084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.016127 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.028618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1357/2685] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 07:03:31.033307 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.043501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb86c2f-f1ff-47be-9c2f-3d34fbca7b5b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.048138 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.048745 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.049050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.049440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.050105 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.051983 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.080787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1329/2686] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:31 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:03:31.085231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.095535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea4d3-f439-433b-a0bb-866f06c08423 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.151795 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.152489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.152774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.153144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.153819 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.155769 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.178230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1358/2687] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:31 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:31.183217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.188924 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:31.195242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef449de-744b-4d79-a939-9479eceb631c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.202312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.203009 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.203344 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.203690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.204528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.206516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.219374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1330/2688] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:31.223476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.234197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07611-9546-4758-a294-e9fa89d23938 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.238930 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.239519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.239787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.240103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.240751 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.242420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22130635-6554-4a7c-8703-355f04b6203a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.255994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1359/2689] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:31.261304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.277309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334687-337b-4031-8e8c-65cbaff10f16 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.282077 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.282746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.283022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.283301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] PATH_INFO: `/v3/projects/9113be1232b740d49d983f8430b3e971/users/78f0c06d18f94c1aac6e105007cca42e/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.299125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9113be1232b740d49d983f8430b3e971, user_id=78f0c06d18f94c1aac6e105007cca42e, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.301831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.314780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1331/2690] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:31 2022] PUT /identity/v3/projects/9113be1232b740d49d983f8430b3e971/users/78f0c06d18f94c1aac6e105007cca42e/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:31.326783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9645-b281-4482-b480-04462732e519 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.327072 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9645-b281-4482-b480-04462732e519 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.327348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9645-b281-4482-b480-04462732e519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.364667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4efe9645-b281-4482-b480-04462732e519 None None] MFA Rules not processed for user `78f0c06d18f94c1aac6e105007cca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:31.365805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4efe9645-b281-4482-b480-04462732e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:31.394228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:31.430736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1360/2691] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:31.442579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.445001 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:31.542545 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ce8f9-bcb8-4d05-8b10-c2699e585c29 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.549845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.550754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.551125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.551405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.560221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.561812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3510-7380-4879-8fc0-1f8864096bbd service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.573684 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1332/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:31.794588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe9645-b281-4482-b480-04462732e519 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:31.857206 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe9645-b281-4482-b480-04462732e519 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:31.861736 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:31.862372 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.862651 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.862925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] PATH_INFO: `/v3/users/78f0c06d18f94c1aac6e105007cca42e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.864209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f0c06d18f94c1aac6e105007cca42e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:31.866165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:31.913154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f0c06d18f94c1aac6e105007cca42e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:31.913822 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f0c06d18f94c1aac6e105007cca42e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:31.914422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f0c06d18f94c1aac6e105007cca42e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:31.921225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f0c06d18f94c1aac6e105007cca42e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:31.932813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f0c06d18f94c1aac6e105007cca42e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:31.945533 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1361/2693] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:31 2022] DELETE /identity/v3/users/78f0c06d18f94c1aac6e105007cca42e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:03:31.950539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:31.950832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:31.951112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:31.970682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:31.971878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:32.031352 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1333/2694] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:32.041662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.043049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:32.096684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:32.100837 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550aecc-62d6-4cfa-b663-e83535bfa857 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.107147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.108016 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.108314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.108783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.117907 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.119527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7550df-232e-44ec-960d-e10b6f0e8294 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.128993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1362/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:32.398028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.399475 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:32.415196 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58652a77-6454-41b4-bb5f-0b9969af3c70 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.420085 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.420765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.421063 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.422062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] PATH_INFO: `/v3/projects/9113be1232b740d49d983f8430b3e971` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.423876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9113be1232b740d49d983f8430b3e971)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.425933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.473875 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:32.475129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9113be1232b740d49d983f8430b3e971', 'request_id': 'req-2fc40e2b-e021-497a-8a59-e761ad89918f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:32.482197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9113be1232b740d49d983f8430b3e971', 'request_id': 'req-2fc40e2b-e021-497a-8a59-e761ad89918f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:32.489664 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9113be1232b740d49d983f8430b3e971', 'request_id': 'req-2fc40e2b-e021-497a-8a59-e761ad89918f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:32.503122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] The token cache is being invalidate because project 9113be1232b740d49d983f8430b3e971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:32.503430 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:32.504013 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2fc40e2b-e021-497a-8a59-e761ad89918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:32.505562 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1334/2696] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:32 2022] DELETE /identity/v3/projects/9113be1232b740d49d983f8430b3e971 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:32.510408 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.510938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.511046 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.531889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:32.533175 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:32.593297 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1363/2697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:32.601192 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.601480 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.601764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.622253 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:32.623445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:32.631261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1335/2698] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:32.635558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.648110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40d8d-a31d-4176-b209-40aec9b4367b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.653315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.653917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.654193 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.654461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.655137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:32.655437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.657022 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.668693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1364/2699] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:03:32.672947 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.682659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80c18-1f08-4374-a6a7-73f9dad2f5de None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.690205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.690882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.691180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.691451 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.692121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.694050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.723742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1336/2700] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:32 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:03:32.727976 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.738000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a857ee9-3b96-4f94-bb7a-3a91374709c9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.794726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.795345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.795629 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.795905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.796561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.798508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.820004 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1365/2701] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:32 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:32.825249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.835549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a1087-5e81-422d-b08f-10ab2c8460a7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.840322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.841027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.841311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.841585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.842268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.844123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.854557 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1337/2702] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:32.858844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.869431 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d43d-b0fc-4d0c-a886-ed47605ed33e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.874838 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.875457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.875762 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.876038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.876731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.878363 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7ea0-85f4-40bb-b496-3468ac36660a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.889745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1366/2703] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:32.893832 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:32.904152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a170c-1dce-4ec1-8b11-a0ca475901e7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:32.908712 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:32.909403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.909685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.909957 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] PATH_INFO: `/v3/projects/f20dd22003444a6d9b32380e7b3dac0a/users/895ddb6679d14738aec3f2b4800521da/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.924346 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20dd22003444a6d9b32380e7b3dac0a, user_id=895ddb6679d14738aec3f2b4800521da, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:32.927021 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:32.940398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1338/2704] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:32 2022] PUT /identity/v3/projects/f20dd22003444a6d9b32380e7b3dac0a/users/895ddb6679d14738aec3f2b4800521da/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:32.951478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:32.951763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:32.952109 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:32.981233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] MFA Rules not processed for user `895ddb6679d14738aec3f2b4800521da`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:32.982397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:33.027307 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:33.048139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1367/2705] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:33.052609 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.114603 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a897ee-5de1-46d8-8a9f-288b47fc0703 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.119421 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.120028 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.120336 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.120610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.122400 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.124294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.151181 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1339/2706] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:33 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:33.156039 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.167096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab4480-179a-4322-b207-f295bf1f1f52 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.227150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.228048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.228421 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.228793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.229740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.232963 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.255364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1368/2707] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:33 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:33.263261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.274486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c299-5af4-4b81-9d36-d41df68d7c58 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.279498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.280107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.280383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.280654 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.281371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.282968 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.303500 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1340/2708] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:03:33.307801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.318683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7174d2-0ae9-45e9-ad5c-093400bbd8ba admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.323316 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.323972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.324605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.325044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] PATH_INFO: `/v3/projects/247cfb1edc264339940079e836993fef/users/3bc2828994a94ba7bffb1f81bec67ea7/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.340835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247cfb1edc264339940079e836993fef, user_id=3bc2828994a94ba7bffb1f81bec67ea7, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.343767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.357826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1369/2709] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:33 2022] PUT /identity/v3/projects/247cfb1edc264339940079e836993fef/users/3bc2828994a94ba7bffb1f81bec67ea7/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:33.361917 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.372511 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3696-c2f3-4e90-ba42-2c55a0faa345 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.415230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:33.430851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.431478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.431819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.432084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.432800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.434617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47fb1b-72f7-48ee-9802-a660e72bacf1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.444578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1341/2710] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:33.448973 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.459140 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc88e-54fc-4799-8144-8ad2634152a8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.463647 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.464294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.464571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.465521 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] PATH_INFO: `/v3/projects/247cfb1edc264339940079e836993fef/users/3bc2828994a94ba7bffb1f81bec67ea7/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.467699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247cfb1edc264339940079e836993fef, user_id=3bc2828994a94ba7bffb1f81bec67ea7, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.470631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.481455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1370/2711] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:33 2022] PUT /identity/v3/projects/247cfb1edc264339940079e836993fef/users/3bc2828994a94ba7bffb1f81bec67ea7/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:33.492942 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.493357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.493636 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.521191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] MFA Rules not processed for user `3bc2828994a94ba7bffb1f81bec67ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:33.522395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:33.591239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1342/2712] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:33.602926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:33.604598 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:33.663505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504cedb-e4d5-4082-9472-35563fef29e9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:33.667139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:33.667754 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:33.668701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:33.668970 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:33.678252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:33.679726 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815679d2-e98f-4117-a57f-af972a0bcd17 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:33.690294 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1371/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:03:34.114414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:34.177404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717ac1-848e-44fc-a603-941d8164dc3e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:34.181971 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:34.182578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:34.182854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:34.183128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] PATH_INFO: `/v3/users/895ddb6679d14738aec3f2b4800521da` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:34.185264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895ddb6679d14738aec3f2b4800521da)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:34.187200 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:34.232418 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895ddb6679d14738aec3f2b4800521da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.233104 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895ddb6679d14738aec3f2b4800521da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.239827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895ddb6679d14738aec3f2b4800521da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.240455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895ddb6679d14738aec3f2b4800521da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.251954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:34.254231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895ddb6679d14738aec3f2b4800521da'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.270170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1343/2714] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:34 2022] DELETE /identity/v3/users/895ddb6679d14738aec3f2b4800521da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:34.274779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:34.275066 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:34.275342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:34.293518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:34.294703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:34.337619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:34.360971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1372/2715] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:34.370756 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:34.372791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:34.429825 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c457d-2151-4def-9e69-6aa0de466e27 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:34.434000 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:34.434607 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:34.434883 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:34.435160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:34.444155 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:34.445614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:34.455878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1344/2716] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:34.736898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:34.738489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:34.752288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0539-a2ea-4cc5-bb9c-b5fcc07e61d9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:34.757057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:34.757713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:34.757994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:34.758271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] PATH_INFO: `/v3/projects/f20dd22003444a6d9b32380e7b3dac0a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:34.759456 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20dd22003444a6d9b32380e7b3dac0a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:34.761415 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:34.810055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20dd22003444a6d9b32380e7b3dac0a', 'request_id': 'req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.814495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20dd22003444a6d9b32380e7b3dac0a', 'request_id': 'req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.821926 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20dd22003444a6d9b32380e7b3dac0a', 'request_id': 'req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.832913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] The token cache is being invalidate because project f20dd22003444a6d9b32380e7b3dac0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:34.833237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.833855 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.835331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1373/2717] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:34 2022] DELETE /identity/v3/projects/f20dd22003444a6d9b32380e7b3dac0a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:34.839356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:34.849813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4902f-b861-44b1-a3f6-60dfc00d3081 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:34.910071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:34.910796 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:34.911125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:34.911443 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] PATH_INFO: `/v3/users/3bc2828994a94ba7bffb1f81bec67ea7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:34.912786 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc2828994a94ba7bffb1f81bec67ea7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:34.915128 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:34.969112 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc2828994a94ba7bffb1f81bec67ea7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.969861 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc2828994a94ba7bffb1f81bec67ea7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.977248 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc2828994a94ba7bffb1f81bec67ea7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.977879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc2828994a94ba7bffb1f81bec67ea7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:34.990999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-001bff6d-a6c9-4c18-a05f-5461cbd4a2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc2828994a94ba7bffb1f81bec67ea7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.004203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1345/2718] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:34 2022] DELETE /identity/v3/users/3bc2828994a94ba7bffb1f81bec67ea7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:03:35.282219 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.283667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:35.297606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e935a-07b6-4f81-8376-4b5790c1a3b1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.359731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.360328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.360611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.360920 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] PATH_INFO: `/v3/projects/247cfb1edc264339940079e836993fef` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.362128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247cfb1edc264339940079e836993fef)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.364041 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.412792 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247cfb1edc264339940079e836993fef', 'request_id': 'req-f6e06a3b-7107-4008-b6bb-591b468e25f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.418078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247cfb1edc264339940079e836993fef', 'request_id': 'req-f6e06a3b-7107-4008-b6bb-591b468e25f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.425331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247cfb1edc264339940079e836993fef', 'request_id': 'req-f6e06a3b-7107-4008-b6bb-591b468e25f2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.427255 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:35.437915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] The token cache is being invalidate because project 247cfb1edc264339940079e836993fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:35.438334 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.439406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f6e06a3b-7107-4008-b6bb-591b468e25f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:35.441384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1374/2719] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:35 2022] DELETE /identity/v3/projects/247cfb1edc264339940079e836993fef => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:35.446209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.446780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.446780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.467169 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:35.468621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:35.473151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:35.532549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1346/2720] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:03:35.540484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.540776 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.541086 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.560641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:35.561884 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:35.569810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1375/2721] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:35.574071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.584185 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5698a26-13e5-4a6e-871a-73f18ddfccf4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.588799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.589435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.589717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.589998 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.591301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:35.591629 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.593528 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.604901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1347/2722] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 07:03:35.609310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.619965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c3a7e-43e2-4d13-80a8-7e8e63dd1bf2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.625679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.626379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.626732 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.627058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.627826 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.630107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.659949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1376/2723] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:35 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:35.664375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.675124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a40c2e-ef54-4f87-933c-2cf1879970b1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.734148 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.734771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.735050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.735323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.736017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.737976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.759690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1348/2724] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:35 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:35.764857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.776371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db0-fb82-4ad4-8cf2-f6404f1ef478 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.781652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.782338 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.782656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.782960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.783753 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.785546 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.795987 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1377/2725] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:03:35.800049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.810542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5fca1-0cce-4a20-945e-c464adcbcf2c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.815202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.815812 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.816090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.816363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.817082 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.818676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d05893-e2b7-4025-b070-a54e63a6eb3a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.829822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1349/2726] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:35.834336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:35.847937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe15c-d156-4c53-bef2-4cab4b5ba4fa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:35.853064 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:35.853820 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.854117 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.854434 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] PATH_INFO: `/v3/projects/9505830113ec404f99777fbed87783e3/users/45038c2664fc4751a5dd6a949fd7b127/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.869717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9505830113ec404f99777fbed87783e3, user_id=45038c2664fc4751a5dd6a949fd7b127, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:35.873068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:35.906564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1378/2727] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:35 2022] PUT /identity/v3/projects/9505830113ec404f99777fbed87783e3/users/45038c2664fc4751a5dd6a949fd7b127/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:35.916894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:35.917363 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:35.917643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:35.956553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] MFA Rules not processed for user `45038c2664fc4751a5dd6a949fd7b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:35.958110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:36.013291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:36.036406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1350/2728] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:36.041067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.139406 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572f2c-5b18-4912-908c-65201ac3903f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.143984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.144600 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.144878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.145181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.145850 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.147746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.174786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1379/2729] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:36 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:36.178920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.190931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2bc42-755b-4f41-b5d2-e86edb0e6a87 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.249073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.249693 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.249970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.250242 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.250899 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.252937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.274331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1351/2730] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:36 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:36.278810 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.289081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84429816-15a8-4e82-a40a-88c7f28db050 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.293531 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.294845 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.295122 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.295390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.296067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.297680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.308125 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1380/2731] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:36.313872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.324072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90472-6e67-42d4-8197-7ec47a85e37c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.328713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.329552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.329668 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.329941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] PATH_INFO: `/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5/users/3f6bae1cd41f46f6b125b94a9eb55d36/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.345209 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a46e8f1b7164fffbef8d7892a0be4b5, user_id=3f6bae1cd41f46f6b125b94a9eb55d36, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.347882 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.361102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1352/2732] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:36 2022] PUT /identity/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5/users/3f6bae1cd41f46f6b125b94a9eb55d36/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:36.365200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.376345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19046-9c9f-4868-9d20-83c6e99422a8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.384940 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:36.433332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.433869 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.434146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.434952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.435649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.437252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572d5a-af81-42ce-99fd-afc58da33739 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.447572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1381/2733] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:36.451772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.462316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3328-871d-4e81-8fa1-651f398f32f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.467610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.468521 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.468794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.469100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] PATH_INFO: `/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5/users/3f6bae1cd41f46f6b125b94a9eb55d36/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.471108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a46e8f1b7164fffbef8d7892a0be4b5, user_id=3f6bae1cd41f46f6b125b94a9eb55d36, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.473829 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.485410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1353/2734] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:36 2022] PUT /identity/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5/users/3f6bae1cd41f46f6b125b94a9eb55d36/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:36.496684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.497143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.497503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.528448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] MFA Rules not processed for user `3f6bae1cd41f46f6b125b94a9eb55d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:36.529774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:36.600481 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1382/2735] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:36.612245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.614518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:36.697039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca155da7-a278-4523-a65f-3b913b15d7e6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.701720 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.702441 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.702770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.703066 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.713667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.715368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.726753 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1354/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:36.774076 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:36.775654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:36.788484 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd15f6-3ac1-4c0a-ae99-54929b738d24 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:36.792157 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:36.792780 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:36.793098 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:36.793379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:36.849981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:36.851420 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382c52d-2ea6-4ee2-b3fb-986bc8d68eba service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:36.860565 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1383/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:40.216408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:40.254931 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:40.298375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a402-e302-41b6-8bd0-aa669099f3d5 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:40.302858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:40.303518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:40.303813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:40.304079 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] PATH_INFO: `/v3/users/45038c2664fc4751a5dd6a949fd7b127` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:40.305274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45038c2664fc4751a5dd6a949fd7b127)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:40.307167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:40.360696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45038c2664fc4751a5dd6a949fd7b127'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.361486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45038c2664fc4751a5dd6a949fd7b127'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.368692 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45038c2664fc4751a5dd6a949fd7b127'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.369527 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45038c2664fc4751a5dd6a949fd7b127'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.386084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45038c2664fc4751a5dd6a949fd7b127'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.401667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1355/2738] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:40 2022] DELETE /identity/v3/users/45038c2664fc4751a5dd6a949fd7b127 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:40.406201 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:40.406782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:40.406782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:40.438254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:40.439520 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:40.461948 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:40.509969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1384/2739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:03:40.520450 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:40.521902 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:40.584188 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e4f5-37fc-4248-84a0-b3ac1defd4bb admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:40.587949 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:40.588621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:40.588893 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:40.589193 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:40.599535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:40.600970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:40.612086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1356/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:40.894998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:40.896608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:40.912798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050ff5-36cc-4254-8728-285f57488b7f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:40.918103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:40.924877 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:40.925225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:40.925562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] PATH_INFO: `/v3/projects/9505830113ec404f99777fbed87783e3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:40.927038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9505830113ec404f99777fbed87783e3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:40.928909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:40.977021 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9505830113ec404f99777fbed87783e3', 'request_id': 'req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.982714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9505830113ec404f99777fbed87783e3', 'request_id': 'req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:40.990554 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9505830113ec404f99777fbed87783e3', 'request_id': 'req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.001854 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] The token cache is being invalidate because project 9505830113ec404f99777fbed87783e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:41.002136 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.002788 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.004350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1385/2741] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:40 2022] DELETE /identity/v3/projects/9505830113ec404f99777fbed87783e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:41.008374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.017941 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd0f9-7e19-46f1-be5a-933d4939963f service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.062765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:41.077634 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.078360 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.078669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.078943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] PATH_INFO: `/v3/users/3f6bae1cd41f46f6b125b94a9eb55d36` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.080101 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6bae1cd41f46f6b125b94a9eb55d36)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.082143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.129071 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6bae1cd41f46f6b125b94a9eb55d36'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.129682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6bae1cd41f46f6b125b94a9eb55d36'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.136955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6bae1cd41f46f6b125b94a9eb55d36'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.137639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6bae1cd41f46f6b125b94a9eb55d36'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.149811 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a50ea216-c157-4856-851b-0c81d7ba43d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6bae1cd41f46f6b125b94a9eb55d36'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.163885 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1357/2742] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:41 2022] DELETE /identity/v3/users/3f6bae1cd41f46f6b125b94a9eb55d36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:41.439312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.440889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:41.454874 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d45cd-40a5-47d2-b8aa-87830aa4e85f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.515588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.516241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.516525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.516805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] PATH_INFO: `/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.518018 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a46e8f1b7164fffbef8d7892a0be4b5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.519913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.567364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a46e8f1b7164fffbef8d7892a0be4b5', 'request_id': 'req-53e7a0f7-df29-4204-b812-8aa1f82138d9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.569879 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:41.575501 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a46e8f1b7164fffbef8d7892a0be4b5', 'request_id': 'req-53e7a0f7-df29-4204-b812-8aa1f82138d9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.583213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a46e8f1b7164fffbef8d7892a0be4b5', 'request_id': 'req-53e7a0f7-df29-4204-b812-8aa1f82138d9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.595225 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] The token cache is being invalidate because project 8a46e8f1b7164fffbef8d7892a0be4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:41.595510 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.596144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-53e7a0f7-df29-4204-b812-8aa1f82138d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:41.597687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1386/2743] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:41 2022] DELETE /identity/v3/projects/8a46e8f1b7164fffbef8d7892a0be4b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:41.602494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.603023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.603023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.650916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:41.652072 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:41.712827 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1358/2744] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:41.721440 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.721727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.722006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.742883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:41.744079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:41.751977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1387/2745] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:03:41.756150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.766405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e523a-5329-4c49-9232-60dfdbbbe39f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.770993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.771600 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.771876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.772145 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.772835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:41.773197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.774872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.787907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1359/2746] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:03:41.792919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.803863 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d43b-7c1f-478d-a0b1-cb117b6930fc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.808466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.809101 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.809384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.809657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.810347 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.812904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.839516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1388/2747] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:41 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:41.845203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.855184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d07683-e1fd-4556-b854-3f4bad933e37 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.880808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:41.913468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.914007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.914286 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.914559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.915228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.917173 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.939090 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1360/2748] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:41.943319 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.954071 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940ab41-803a-45a7-849d-50381a333b96 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.958704 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.959310 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.959589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.959857 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.960542 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.962147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:41.973340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1389/2749] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:41.977339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:41.989236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869264-dc67-4aef-84c1-c7155e697120 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:41.993865 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:41.994478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:41.994759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:41.995034 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:41.995717 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:41.997337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01819-b9df-49d9-a9e6-24c9f2ab69cf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:42.008379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1361/2750] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:42.013234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:42.025394 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839540-66c2-4bc4-ac45-42359a1ef112 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:42.031340 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:42.032135 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:42.032464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:42.032793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] PATH_INFO: `/v3/projects/de2ac1f2883e4844b7f9542a0fe42c43/users/672849d55c1d4fe89703904c0bfaf16d/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:42.049467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2ac1f2883e4844b7f9542a0fe42c43, user_id=672849d55c1d4fe89703904c0bfaf16d, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:42.052627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:42.067348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1390/2751] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:42 2022] PUT /identity/v3/projects/de2ac1f2883e4844b7f9542a0fe42c43/users/672849d55c1d4fe89703904c0bfaf16d/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:42.079961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:42.080268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:42.080548 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:42.117553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] MFA Rules not processed for user `672849d55c1d4fe89703904c0bfaf16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:42.118754 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:42.182697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1362/2752] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:42.194150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:42.195923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:42.254096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c44339-b5c8-41ac-b1bd-5ca86eebbf7b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:42.257782 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:42.258397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:42.258679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:42.258951 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:42.268370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:42.269716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bbc5f-a22a-49f7-9a9e-e9529969487e service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:42.278427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1391/2753] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:52.179631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:52.274464 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:52.352659 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:52.424849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358572-cf26-4441-8f8b-cfa43dd0766d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:52.429574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:52.430278 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:52.430504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:52.430779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] PATH_INFO: `/v3/users/672849d55c1d4fe89703904c0bfaf16d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:52.431947 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672849d55c1d4fe89703904c0bfaf16d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:52.433915 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:52.481123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672849d55c1d4fe89703904c0bfaf16d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:52.481780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672849d55c1d4fe89703904c0bfaf16d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:52.489939 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672849d55c1d4fe89703904c0bfaf16d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:52.490617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672849d55c1d4fe89703904c0bfaf16d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:52.505236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672849d55c1d4fe89703904c0bfaf16d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:52.519978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1363/2754] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:03:52 2022] DELETE /identity/v3/users/672849d55c1d4fe89703904c0bfaf16d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:03:52.524410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e234f-236b-40b1-8794-fee4f300577d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:52.524701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e234f-236b-40b1-8794-fee4f300577d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:52.525031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e234f-236b-40b1-8794-fee4f300577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:52.545036 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-637e234f-236b-40b1-8794-fee4f300577d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:52.546614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-637e234f-236b-40b1-8794-fee4f300577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:52.612683 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1392/2755] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:52.622201 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:52.623898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:52.684608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e11d0-0249-45f3-9770-98ddf345ca55 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:52.688151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:52.688867 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:52.689179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:52.689453 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:52.698718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:52.700220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c177c8-4288-461a-89e8-59d4d12ba3bb service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:52.711318 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1364/2756] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:53.000942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e234f-236b-40b1-8794-fee4f300577d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.002460 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-637e234f-236b-40b1-8794-fee4f300577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:53.018478 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e234f-236b-40b1-8794-fee4f300577d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.023485 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.024158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.024465 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.024696 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] PATH_INFO: `/v3/projects/de2ac1f2883e4844b7f9542a0fe42c43` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.026065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2ac1f2883e4844b7f9542a0fe42c43)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.027955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.075084 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2ac1f2883e4844b7f9542a0fe42c43', 'request_id': 'req-0fc1cd92-ac66-4d21-9022-8158ea8c0016'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:53.081881 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2ac1f2883e4844b7f9542a0fe42c43', 'request_id': 'req-0fc1cd92-ac66-4d21-9022-8158ea8c0016'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:53.089479 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2ac1f2883e4844b7f9542a0fe42c43', 'request_id': 'req-0fc1cd92-ac66-4d21-9022-8158ea8c0016'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:53.101676 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] The token cache is being invalidate because project de2ac1f2883e4844b7f9542a0fe42c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:03:53.101955 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:53.102665 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0fc1cd92-ac66-4d21-9022-8158ea8c0016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:03:53.104327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1393/2757] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:03:52 2022] DELETE /identity/v3/projects/de2ac1f2883e4844b7f9542a0fe42c43 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:53.109591 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.109933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.110249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.130494 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:53.131711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:53.151906 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:53.212783 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1365/2758] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:53.221199 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.221624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.222032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.245215 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:53.246584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:53.257145 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1394/2759] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:53.261667 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.273474 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c474ea8-9eb8-49f3-984f-e2b268cb66a4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.278260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.278874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.279150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.279456 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.280463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:03:53.280819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.282448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.294937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1366/2760] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:03:53.300801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.312323 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b579a51-8132-4576-9355-e74f60fe36aa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.317113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.317731 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.318007 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.318280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.318932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.320924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.350489 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1395/2761] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:03:53 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:53.355391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.367309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56a57-169d-4332-86f2-8910f4f8d033 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.424016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.424632 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.424908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.425207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.425872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.427770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.450746 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1367/2762] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:03:53 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:03:53.455832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.466758 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddec72-f49f-49b4-b52e-2bcd36ff0f5a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.471757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.472371 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.472650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.472924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.473671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.475572 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.487010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1396/2763] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:53.490466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.502099 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d15b-6791-4604-87d5-4fae4aeaca3c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.507073 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.507727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.508044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.508312 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.508956 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.510561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774097-bc80-43d4-bb92-22ea70c40df0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.522317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1368/2764] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:03:53.526512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.538090 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e0e9-3836-4c38-b869-35804b4540d3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.548866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.550133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.550570 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.550794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] PATH_INFO: `/v3/projects/72915741a6564f23b52653adda98cfdf/users/33b02dfb601a4c8da2d7d9a1e6b32404/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.568053 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72915741a6564f23b52653adda98cfdf, user_id=33b02dfb601a4c8da2d7d9a1e6b32404, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.570743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.583947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1397/2765] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:03:53 2022] PUT /identity/v3/projects/72915741a6564f23b52653adda98cfdf/users/33b02dfb601a4c8da2d7d9a1e6b32404/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:03:53.588952 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776977-1d6a-4584-ad4d-2909c1119737 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.589287 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776977-1d6a-4584-ad4d-2909c1119737 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.589534 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2776977-1d6a-4584-ad4d-2909c1119737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.610379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e2776977-1d6a-4584-ad4d-2909c1119737 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:53.611561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e2776977-1d6a-4584-ad4d-2909c1119737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:53.671299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1369/2766] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:53.681815 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:53.683517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:53.707529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:53.744916 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e71c4-4354-42ed-a3b5-1a5651b76026 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:53.748622 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:53.749257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:53.749534 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:53.749805 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:53.758794 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:53.760200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:53.769601 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1398/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:54.492260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54965f37-cc09-4d29-a9af-344354f73256 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:54.492782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54965f37-cc09-4d29-a9af-344354f73256 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:54.492964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54965f37-cc09-4d29-a9af-344354f73256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:54.528921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-54965f37-cc09-4d29-a9af-344354f73256 None None] MFA Rules not processed for user `33b02dfb601a4c8da2d7d9a1e6b32404`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:54.530851 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-54965f37-cc09-4d29-a9af-344354f73256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:54.548532 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:03:54.606429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1370/2768] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:54.617604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:54.619107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:54.686496 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19240c-c800-4c78-9177-af470805761d service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:54.690924 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:54.691690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:54.692014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:54.692341 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:54.702978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:54.704429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:54.714564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1399/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:03:56.090429 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:56.090954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:56.090954 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:56.110331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] MFA Rules not processed for user `33b02dfb601a4c8da2d7d9a1e6b32404`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:03:56.111779 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:56.118738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1371/2770] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:03:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:03:57.234437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:03:57.236387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:57.335992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010cb23-ecc5-4a32-a9e2-2c5fbfca22b8 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:03:57.341048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:03:57.341667 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:03:57.341946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:03:57.342222 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:03:57.344998 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:03:57.357113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:03:57.358684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:03:57.370040 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1400/2771] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:03:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:04:06.104805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=22 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:04:07.365602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:05:33.435282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:05:33.456134 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5802-aa82-4329-af63-ff37bbd679ac None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:05:33.459703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:05:33.460311 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:05:33.460590 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:05:33.460863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:05:33.462615 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:05:33.555920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:05:33.557408 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:05:33.580046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1372/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:05:34.687191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:05:34.689167 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:05:34.715154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42d7aa-71e1-47b7-b784-6233a19e3777 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:05:34.719746 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:05:34.721078 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:05:34.721462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:05:34.721847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:05:34.723882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:05:34.737814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:05:34.739233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:05:34.750190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1401/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:05:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:05:43.576149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=50 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:05:44.745229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:06:39.770050 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:06:39.771460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:06:39.785154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00b12d-3bda-4bf5-8ce3-7b6d7006fa1b service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:06:39.790596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:06:39.791205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:06:39.791484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:06:39.791757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:06:39.793535 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:06:39.851788 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:06:39.853439 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:06:39.862519 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1373/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:06:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:06:45.932094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:06:45.941354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91cdee-3a88-46e3-ab4b-2822a834e9da service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:06:45.944853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:06:45.945492 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:06:45.945774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:06:45.946051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:06:45.947767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:06:45.958074 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:06:45.959419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:06:45.967537 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1402/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:06:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:06:49.858279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=28 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:06:55.963793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:09:27.969739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:09:27.989544 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacc7-4e3c-48fa-b7e3-c2b8c2bc1447 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:09:27.993549 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:09:27.994239 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:09:27.994665 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:09:27.994970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:09:27.997086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:09:28.058062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:09:28.059582 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:09:28.068410 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1374/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:09:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:09:28.116241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:09:28.126038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2f84-c74f-4507-9a6b-2b3379bbc282 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:09:28.129483 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:09:28.130082 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:09:28.130358 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:09:28.130631 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:09:28.139048 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:09:28.140444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:09:28.150351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1403/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:09:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:09:38.064330 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=32 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:09:38.145461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:09:50.268251 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:09:50.279969 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97d55-1441-4435-8b06-3aa954ac4242 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:09:50.284973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:09:50.285597 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:09:50.285873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:09:50.286142 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:09:50.295038 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:09:50.296594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:09:50.306946 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1375/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:09:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:10:00.302205 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:10:33.965802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:10:33.976393 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39081b35-a883-4ff0-9f60-1265cb17135c service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:10:33.979929 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:10:33.980528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:10:33.980807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:10:33.981128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:10:33.991645 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:10:33.993085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:10:34.004344 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1404/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:10:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:10:35.110625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:10:35.120030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f55a-456a-4557-b9e7-b73a828841f0 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:10:35.124319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:10:35.124928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:10:35.125254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:10:35.125526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:10:35.135739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:10:35.137191 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:10:35.148803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1376/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:10:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:10:43.999666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:10:45.144014 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:11:40.983170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:11:40.994868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509774e8-3af1-4cb1-84fc-72816863dfe5 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:11:41.000455 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:11:41.001096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:11:41.001379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:11:41.001653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:11:41.009637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:11:41.011200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:11:41.038902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1405/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:11:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:11:51.035896 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=13 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:11:53.723575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:11:53.732558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abcf-d1de-4330-818c-fc8cc6897f1d service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:11:53.736696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:11:53.737328 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:11:53.737606 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:11:53.737874 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:11:53.747898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:11:53.750194 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:11:53.762314 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1377/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:11:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:12:03.756617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:14:28.574009 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:14:28.615497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6daf2c-e6e1-413e-8159-10abff52456a service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:14:28.621010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:14:28.621623 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:14:28.621903 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:14:28.622178 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:14:28.624608 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:14:28.712679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:14:28.714335 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:14:28.733093 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1406/2783] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:14:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:14:38.730353 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=59 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:14:55.292833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:14:55.294625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:14:55.410157 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a105e-4bf7-49df-9858-bd5b214a4a0e service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:14:55.415569 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:14:55.416281 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:14:55.416678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:14:55.417095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:14:55.419895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:14:55.432238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:14:55.433840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:14:55.444045 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1378/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:15:05.439822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=50 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:15:28.738918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:15:28.738918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:15:28.764104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597fd7-4c32-4531-ace5-9d7bb2b223ce service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:15:28.772200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:15:28.773210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:15:28.773653 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:15:28.774091 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:15:28.786812 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:15:28.788370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:15:28.818422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1407/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:15:38.815584 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=13 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:16:42.222267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:16:42.223776 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:16:42.293710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581562c-e435-4fbe-ae32-fa6f17a729bc service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:16:42.297922 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:16:42.298541 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:16:42.298819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:16:42.299120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:16:42.301016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:16:42.372644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:16:42.374238 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:16:42.384221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1379/2786] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:16:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:16:52.379894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=58 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:16:55.919049 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:16:55.921342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:16:56.001314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2c90-dc4b-4df1-b7c9-3454c67ea6a2 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:16:56.004882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:16:56.005524 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:16:56.005803 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:16:56.006102 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:16:56.007949 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:16:56.017585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:16:56.019014 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:16:56.027403 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1408/2787] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:16:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:17:06.024134 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=35 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:19:29.409709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:19:29.411292 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:19:29.431402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b4fef-7ede-4540-a928-302d27252f69 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:19:29.434996 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:19:29.435601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:19:29.435880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:19:29.436154 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:19:29.444647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:19:29.446094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:19:29.454804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1380/2788] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:19:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:19:39.450826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:19:59.290981 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:19:59.303602 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915336-fe6f-4aeb-8444-f25510b37b62 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:19:59.308656 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:19:59.309306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:19:59.309585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:19:59.309852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:19:59.319498 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:19:59.321253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:19:59.331846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1409/2789] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:19:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:20:09.327210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:20:28.337807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:20:28.346724 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293969e-cf24-4313-b3e7-5b4bb2400a4d service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:20:28.350345 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:20:28.350943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:20:28.351225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:20:28.351495 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:20:28.353912 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:20:28.424298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:20:28.425750 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:20:28.435062 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1381/2790] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:20:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:20:38.431107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=33 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:21:29.887266 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:29.888885 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:29.901099 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d56d-d802-40fc-bce3-40091864ba05 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:29.905245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:29.905952 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:29.906251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:29.906525 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:29.908603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:30.002960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:30.004296 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:30.025354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1410/2791] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:21:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:21:31.231027 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:31.241266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1ee0d-a109-4641-b2af-a6e5f77e299f service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:31.246297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:31.246921 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:31.247198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:31.247469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:31.250245 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:31.346757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:31.349030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:31.377388 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1382/2792] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:21:32.404100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:32.413038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad5159-15ee-413e-8d20-b7643fa8d13f service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:32.418791 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:32.419429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:32.419706 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:32.419979 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:32.422063 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:32.436880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:32.438333 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:32.449407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1411/2793] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:21:34.478151 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:34.491919 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310144f-47aa-4767-ac25-ff2ad67c9515 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:34.498901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:34.500260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:34.500862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:34.501759 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:34.503374 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:34.517143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:34.519074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:34.535770 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1383/2794] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:21:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:21:37.932922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:37.950120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20a52-cd50-4647-a328-8c89bc4416aa service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:37.957143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:37.957717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:37.958003 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:37.958281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:37.960067 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:37.976205 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:37.978185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:37.991160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1412/2795] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:21:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:21:38.010631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:38.012129 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:38.029608 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf77a-b4f0-4473-9d8f-1aa75aac9d01 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:38.036265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:38.036916 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:38.037225 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:38.037498 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] PATH_INFO: `/v3/users/b17a00d68d66412aaddb2235efcc18f5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:38.038647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17a00d68d66412aaddb2235efcc18f5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:38.040572 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:38.095625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17a00d68d66412aaddb2235efcc18f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.096279 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17a00d68d66412aaddb2235efcc18f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.103309 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17a00d68d66412aaddb2235efcc18f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.104058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17a00d68d66412aaddb2235efcc18f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.116847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17a00d68d66412aaddb2235efcc18f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.132445 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1384/2796] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:21:38 2022] DELETE /identity/v3/users/b17a00d68d66412aaddb2235efcc18f5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:21:38.351183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:38.376339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efafad-a687-4164-a452-dd32989a3201 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:38.443846 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:38.444495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:38.444774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:38.445081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] PATH_INFO: `/v3/projects/1a35c85ffe5c48938eaf14dd1ab2395e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:38.446230 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a35c85ffe5c48938eaf14dd1ab2395e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:38.448781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:38.485928 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:21:38.497100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a35c85ffe5c48938eaf14dd1ab2395e', 'request_id': 'req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.502459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a35c85ffe5c48938eaf14dd1ab2395e', 'request_id': 'req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.510666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a35c85ffe5c48938eaf14dd1ab2395e', 'request_id': 'req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.522405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] The token cache is being invalidate because project 1a35c85ffe5c48938eaf14dd1ab2395e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:21:38.522690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.523342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.524861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1413/2797] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:21:38 2022] DELETE /identity/v3/projects/1a35c85ffe5c48938eaf14dd1ab2395e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:21:38.529108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:38.530575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:38.544091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bf32-6d80-40d1-b875-997478f3526a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:38.565250 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:21:38.607029 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:38.607682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:38.607962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:38.608236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] PATH_INFO: `/v3/users/56b61864cf134ec9baaa6caebbf15f2e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:38.622892 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b61864cf134ec9baaa6caebbf15f2e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:38.624854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:38.672858 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b61864cf134ec9baaa6caebbf15f2e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.673579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b61864cf134ec9baaa6caebbf15f2e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.680678 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b61864cf134ec9baaa6caebbf15f2e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.681364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b61864cf134ec9baaa6caebbf15f2e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.693878 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b61864cf134ec9baaa6caebbf15f2e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:38.707836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1385/2798] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:21:38 2022] DELETE /identity/v3/users/56b61864cf134ec9baaa6caebbf15f2e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:21:38.898599 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:21:38.900379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:21:38.914720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ad44-e41f-4ce7-94b0-90b7118e8e3f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:21:38.996935 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:21:38.997814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:21:38.998192 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:21:38.998562 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] PATH_INFO: `/v3/projects/91cffcb3c95641d788510123f00d72cb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:21:39.011356 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cffcb3c95641d788510123f00d72cb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:21:39.013463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:21:39.073504 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cffcb3c95641d788510123f00d72cb', 'request_id': 'req-5356b787-1d6b-4fba-b4f8-f80db657611e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:39.079435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cffcb3c95641d788510123f00d72cb', 'request_id': 'req-5356b787-1d6b-4fba-b4f8-f80db657611e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:39.086594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cffcb3c95641d788510123f00d72cb', 'request_id': 'req-5356b787-1d6b-4fba-b4f8-f80db657611e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:39.099274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] The token cache is being invalidate because project 91cffcb3c95641d788510123f00d72cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:21:39.099561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:39.100229 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:21:39.101770 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1414/2799] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:21:38 2022] DELETE /identity/v3/projects/91cffcb3c95641d788510123f00d72cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:21:48.704564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:21:49.096123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=12,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:22:05.733397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:22:05.735083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:22:05.792898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd8f6-c206-4fc3-85fc-aaec6f42f0dc admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:22:05.844289 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:22:05.846594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:22:05.846876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:22:05.847149 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:22:05.848991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:22:05.858907 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:22:05.860533 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:22:05.868860 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1386/2800] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:22:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:22:15.865160 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=46 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:23:32.781739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:23:32.783204 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:23:32.892494 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b787-1d6b-4fba-b4f8-f80db657611e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:23:32.900603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:23:32.901630 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:23:32.902116 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:23:32.902579 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:23:32.904505 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:23:32.919724 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:23:32.922190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:23:32.934160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1415/2801] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:23:42.929773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=34 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:24:29.038320 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:24:29.072845 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0b14-872d-49ed-8d8f-94e1edab270f service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:24:29.078518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:24:29.079130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:24:29.079406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:24:29.079681 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:24:29.081486 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:24:29.169649 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:24:29.171240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:24:29.189662 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1387/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:24:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:24:39.187081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=54 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:25:08.384304 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:25:08.386186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:25:08.529528 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4efdb-6d1c-40b9-9244-0a562d79281a service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:25:08.534571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:25:08.535185 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:25:08.535462 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:25:08.535734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:25:08.537480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:25:08.549605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:25:08.551154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:25:08.560891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1416/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:25:18.556624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=63 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:25:28.275362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:25:28.276894 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:25:28.298839 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af5856-b4d9-4bbd-82ee-b9f69380a07c service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:25:28.302440 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:25:28.303064 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:25:28.303343 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:25:28.303617 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:25:28.305517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:25:28.371516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:25:28.372967 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:25:28.382295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1388/2804] 10.222.0.36 () {60 vars in 1396 bytes} [Thu Aug 4 07:25:28 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:25:38.378097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=33 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:26:29.354799 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:26:29.356130 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:26:29.368246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3533-b08f-4e60-b2eb-3d2c6b697eb7 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:26:29.372351 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:26:29.373005 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:26:29.373287 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:26:29.373566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:26:29.375329 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:26:29.390361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:26:29.391798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:26:29.403969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1417/2805] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:26:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:26:32.194265 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:26:32.203120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5dde4-4199-4660-ae7a-5d180c943c6e service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:26:32.206991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:26:32.207601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:26:32.207880 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:26:32.208152 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:26:32.210002 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:26:32.225207 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:26:32.226663 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c510dd-f575-4e7d-b645-e92c02d036d0 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:26:32.238566 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1389/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:26:39.398535 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:26:42.233455 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:29:31.343370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:31.344083 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:31.451974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c946f-0790-46f1-bf56-166ac391360c service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:31.457028 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:31.458020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:31.458354 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:31.458666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:31.470216 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:31.472034 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:31.484203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1418/2807] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:29:32.753661 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:32.754560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:32.754560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:32.799371 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] MFA Rules not processed for user `3e382103f58f4fed84fe67795926c74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:29:32.800637 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:32.818909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1390/2808] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:29:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:29:33.173264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:33.198422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e7b42-ae00-4044-b7d5-37732e3994b4 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:33.202315 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:33.203058 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:33.203391 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:33.203699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:33.205577 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:33.231945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:33.233423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:33.242807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1419/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:29:33.675677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:33.677993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:33.703284 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644b8fb-af56-4965-ab64-531c5ade739d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:33.712080 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:33.712800 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:33.713444 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:33.713808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:33.716035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:33.729757 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:33.731366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:33.752420 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1391/2810] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:29:36.157733 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:36.169992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3946-84a8-4dfa-bcfe-e83a19c7d7b5 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:36.174575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:36.175339 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:36.175727 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:36.176107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:36.187164 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:36.189070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:36.201286 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1420/2811] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:29:36.970648 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:36.998599 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e114b-a989-4dcc-bef2-9b4c4152a614 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:37.004849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:37.005271 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:37.005764 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:37.006231 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:37.017905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:37.019574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:37.034143 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1392/2812] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:29:43.085346 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:43.100694 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ec5a-b454-47b0-a5ec-e2d70644ec96 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:43.108523 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:43.109320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:43.109700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:43.109985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:43.112020 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:43.126913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:43.128670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:43.141635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1421/2813] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:29:47.027459 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=26 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:29:47.579323 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:29:47.593404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7882ca-ef00-4af9-bfb6-3f93b6fa9ce0 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:29:47.600131 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:29:47.601303 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:29:47.601710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:29:47.602227 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:29:47.604496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:29:47.620592 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:29:47.622871 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:29:47.639469 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1393/2814] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:29:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:29:53.136368 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=62 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:29:57.630022 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:30:12.277508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:30:12.291461 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86c618-2a5a-46ec-b562-321a3f3b1bbe service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:30:12.297144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:30:12.297806 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:30:12.298152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:30:12.298364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:30:12.310719 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:30:12.312405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:30:12.325801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1422/2815] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:30:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:30:22.319872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:31:24.212771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:31:24.224016 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f4d1a-263e-44b7-b2dd-89bd40cb010e service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:31:24.229391 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:31:24.230024 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:31:24.230304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:31:24.230580 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:31:24.239272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:31:24.240847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:31:24.250379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1394/2816] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:31:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:31:34.245937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=6 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:30.653410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:34:30.654984 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:34:30.666873 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff0ba1-c513-4f6c-9b9b-6b82d3f9dab5 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:34:30.670946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:34:30.671561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:34:30.671868 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:34:30.672110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:34:30.674033 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:34:30.759231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:34:30.760685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720319-601e-4dd4-b979-c1ae399c295e service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:34:30.781181 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1423/2817] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:34:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:34:40.777906 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=41 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:35:15.263680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:15.265477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:15.418898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10ff27-3429-47fd-bc84-e5efa6084de4 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:15.424612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:15.425449 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:15.425831 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:15.426221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:15.428327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:15.441808 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:15.443409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:15.454107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1395/2818] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:25.449428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=58 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:35:35.549211 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:35.549798 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:35.549969 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:35.583615 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] MFA Rules not processed for user `33b02dfb601a4c8da2d7d9a1e6b32404`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:35:35.585128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:35.596834 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1424/2819] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:35:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:35:35.647146 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:35.648689 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:35.768560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c00a-7cf2-4f42-bc62-b8ed3c5c4adb service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:35.772298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b61207b59f467596d6457eb998244d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:35.772928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:35.773230 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:35.773504 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:35.858171 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:35.859633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:35.882361 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1396/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:36.102604 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:36.161442 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afa324-f255-4267-9683-53c1787d35f9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:36.166303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:36.166967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:36.167246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:36.167516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:36.175435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:36.176856 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:36.185133 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1425/2821] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:35:38.546993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:38.559538 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45766f6-fe41-4e2a-9b50-abac172d038d service glance] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:38.564709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:38.565377 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:38.565679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:38.565955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:38.576483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:38.578109 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:38.591412 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1397/2822] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:43.815643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:43.817424 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:43.838843 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b2dc7-b654-47db-a8d0-8d8bbe0d8aaf service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:43.845045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:43.846123 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:43.846644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:43.847144 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:43.852891 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:43.864490 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:43.865959 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:43.874968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1426/2823] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:44.501810 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:44.504471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:44.542472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943cfe-79bb-49a0-b02b-6082c166fd9f service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:44.549030 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:44.549639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:44.550299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:44.550299 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:44.552999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:35:44.566744 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:44.568409 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:44.581304 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1398/2824] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:50.581883 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:35:50.604331 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d286a-cf3a-4f10-b565-42fa789d1f15 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:35:50.609993 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2245988d98b1408bba171ce6979796b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:35:50.610605 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:35:50.610887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:35:50.611170 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:35:50.621300 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:35:50.622913 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:35:50.635990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1427/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:35:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:54.576023 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:00.630817 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=46 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:24.593065 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:36:24.603115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939bd9-fe2f-4271-b5e7-c9ddf6d63028 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:36:24.606775 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:36:24.607396 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:36:24.607676 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:36:24.607947 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:36:24.609863 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:36:24.693813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:36:24.695593 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:36:24.712403 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1399/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:36:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:36:34.703319 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=33 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:42.972151 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:36:42.982208 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b463a-1bb3-4492-96ae-1c634d74247c service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:36:42.985983 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:36:42.986594 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:36:42.986872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:36:42.987143 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:36:42.988866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:36:43.081781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:36:43.083237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:36:43.103355 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1428/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:36:43.551044 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:36:43.562873 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826ff4-eb4b-43eb-9f37-89296da5d04b service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:36:43.567703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:36:43.568340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:36:43.568645 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:36:43.569172 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:36:43.570999 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:36:43.583806 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:36:43.586573 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:36:43.598476 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1400/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:36:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:36:43.618110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:36:43.619566 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:36:43.631714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14552-6f0b-46e0-b408-2a9b704c626f service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:36:43.637699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:36:43.638364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:36:43.638680 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:36:43.638894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] PATH_INFO: `/v3/users/33b02dfb601a4c8da2d7d9a1e6b32404` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:36:43.640274 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b02dfb601a4c8da2d7d9a1e6b32404)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:36:43.642320 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:36:43.693713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b02dfb601a4c8da2d7d9a1e6b32404'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:43.694690 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b02dfb601a4c8da2d7d9a1e6b32404'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:43.695303 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b02dfb601a4c8da2d7d9a1e6b32404'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:43.702889 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b02dfb601a4c8da2d7d9a1e6b32404'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:43.716186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b02dfb601a4c8da2d7d9a1e6b32404'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:43.729701 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1429/2829] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:36:43 2022] DELETE /identity/v3/users/33b02dfb601a4c8da2d7d9a1e6b32404 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:36:43.913468 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:36:43.924505 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511a01b-a477-4cb1-ae7e-d8b3185af514 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:36:43.987298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:36:43.987937 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:36:43.988213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:36:43.988483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] PATH_INFO: `/v3/projects/72915741a6564f23b52653adda98cfdf` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:36:43.989699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72915741a6564f23b52653adda98cfdf)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:36:43.991699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:36:44.042847 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72915741a6564f23b52653adda98cfdf', 'request_id': 'req-474b85fd-3ac5-46fb-9249-d38df67b5a47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:44.048733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72915741a6564f23b52653adda98cfdf', 'request_id': 'req-474b85fd-3ac5-46fb-9249-d38df67b5a47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:44.055625 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72915741a6564f23b52653adda98cfdf', 'request_id': 'req-474b85fd-3ac5-46fb-9249-d38df67b5a47'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:44.068508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] The token cache is being invalidate because project 72915741a6564f23b52653adda98cfdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:36:44.068789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:44.069904 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:36:44.071530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1401/2830] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:36:43 2022] DELETE /identity/v3/projects/72915741a6564f23b52653adda98cfdf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:36:53.725079 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:54.065438 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:31.608370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:31.610113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:31.675165 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2719-ebe8-4f25-b15d-97ecc17d28e5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:31.740238 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:31.740901 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:31.741191 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:31.741519 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:31.743271 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:31.816112 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:31.819437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:31.838124 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1430/2831] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:35.208237 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:35.209984 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:35.222787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b85fd-3ac5-46fb-9249-d38df67b5a47 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:35.227339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:35.227978 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.228254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.228518 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] PATH_INFO: `/v3/users/3e382103f58f4fed84fe67795926c74c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.229677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e382103f58f4fed84fe67795926c74c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:35.231578 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:35.281460 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e382103f58f4fed84fe67795926c74c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.282067 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e382103f58f4fed84fe67795926c74c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.289673 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e382103f58f4fed84fe67795926c74c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.290483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e382103f58f4fed84fe67795926c74c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.304094 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f34b8a6f-bb7c-4e11-b331-00afc04a6388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e382103f58f4fed84fe67795926c74c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.318610 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1402/2832] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:35 2022] DELETE /identity/v3/users/3e382103f58f4fed84fe67795926c74c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:37:35.516029 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:35.527429 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99d245-19b7-47b0-8ec1-5e0fee565895 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:35.592441 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:35.593337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.593575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.593887 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] PATH_INFO: `/v3/projects/9e3fd12cd57b47cfa4ef21df9cf4d5a9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.594971 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3fd12cd57b47cfa4ef21df9cf4d5a9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:35.597011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:35.606771 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:35.650723 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3fd12cd57b47cfa4ef21df9cf4d5a9', 'request_id': 'req-8a0c4a3b-8840-43c7-8379-2248246883ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.656262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3fd12cd57b47cfa4ef21df9cf4d5a9', 'request_id': 'req-8a0c4a3b-8840-43c7-8379-2248246883ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.665946 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3fd12cd57b47cfa4ef21df9cf4d5a9', 'request_id': 'req-8a0c4a3b-8840-43c7-8379-2248246883ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.679977 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] The token cache is being invalidate because project 9e3fd12cd57b47cfa4ef21df9cf4d5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:35.680228 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.680814 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8a0c4a3b-8840-43c7-8379-2248246883ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:35.682580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1431/2833] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:35 2022] DELETE /identity/v3/projects/9e3fd12cd57b47cfa4ef21df9cf4d5a9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:35.688220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.688506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.688785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.750561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:35.751781 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:35.811301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1403/2834] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:35.819312 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.819641 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.819918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.839708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:35.840922 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:35.849399 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1432/2835] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:35.853715 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:35.864247 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d15f-815d-4674-8d52-fda4081c4909 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:35.868702 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:35.869362 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.869631 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.869900 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.870585 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:37:35.870887 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:35.872482 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:35.884727 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1404/2836] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:37:35.889180 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:35.899006 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1fd5a-dc0d-47ed-9c86-d6d8eccb0d2e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:35.903659 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:35.904306 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:35.904587 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:35.904859 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:35.905603 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:35.907508 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:35.946177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1433/2837] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:35 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:35.950437 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:35.961787 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5ba5-cb41-4513-9433-fa6e7ca0309f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:35.989385 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:36.022074 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.022697 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.022973 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.023243 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.023909 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.025853 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.047732 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1405/2838] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:35 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:36.052497 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.063298 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7193-e4a3-4782-a191-08dcb0673456 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.068779 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.069476 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.069757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.070038 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.070763 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.072370 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.084023 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1434/2839] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:37:36.088213 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.099026 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e00301-295c-42de-91a9-afda2d77f624 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.103723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.104337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.104620 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.104890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.105605 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.107232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f3278-0a66-473d-9e2f-b228bcfa6971 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.119960 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1406/2840] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:36.124239 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.134544 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e29f-84d2-4f04-9957-a5a3a5e9a880 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.139580 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.140252 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.140529 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.140802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] PATH_INFO: `/v3/projects/7e23d1e4f4d44929b09dab573340d6bb/users/9c802f8f554b4552a570b7aff583869f/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.156380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e23d1e4f4d44929b09dab573340d6bb, user_id=9c802f8f554b4552a570b7aff583869f, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.159051 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.176030 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1435/2841] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:36 2022] PUT /identity/v3/projects/7e23d1e4f4d44929b09dab573340d6bb/users/9c802f8f554b4552a570b7aff583869f/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:36.187372 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.187655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.187926 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.217850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] MFA Rules not processed for user `9c802f8f554b4552a570b7aff583869f`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:36.218841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:36.293452 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1407/2842] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:36.297909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.364804 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91e7d-cf72-4a05-932e-aba4e6265c8f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.369493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.370110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.370387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.370657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.371321 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.373254 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.409392 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1436/2843] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:36 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:36.413918 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.426214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fffeef-2c95-4f29-a7d6-6f21aadfbbc7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.485266 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.485803 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.486083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.486355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.487011 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.489579 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.511734 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1408/2844] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:36 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:36.515923 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.527894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234a23-15d3-40e5-8112-6a1b273f3062 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.533482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.534103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.534379 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.534650 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.535454 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.537245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.539628 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:36.549262 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1437/2845] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:36.553604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.563817 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd478-e05b-444e-8a21-9af5f670fe17 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.569638 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.570481 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.570854 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.571228 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] PATH_INFO: `/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa/users/abbe424bcc9941c28494ab68dada13ae/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.588454 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef5a6986c0341fe8a25f7c3071b8dfa, user_id=abbe424bcc9941c28494ab68dada13ae, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.591125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.605624 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1409/2846] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:36 2022] PUT /identity/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa/users/abbe424bcc9941c28494ab68dada13ae/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:36.609938 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.620480 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b311d4-d3d2-4dda-aaef-698523f52381 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.678643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.679279 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.679564 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.679841 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.680575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.682365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b30e-9444-4df9-ac09-f1c4009b225b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.693070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1438/2847] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:37:36.697653 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.703083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:36.711267 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536737b-8f3a-4b92-8f6b-4d7077cfbae3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.716405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.717115 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.717394 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.717674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] PATH_INFO: `/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa/users/abbe424bcc9941c28494ab68dada13ae/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.719621 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef5a6986c0341fe8a25f7c3071b8dfa, user_id=abbe424bcc9941c28494ab68dada13ae, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.722326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.733189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1410/2848] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:36 2022] PUT /identity/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa/users/abbe424bcc9941c28494ab68dada13ae/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:37:36.744405 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.744627 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.744908 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.774011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] MFA Rules not processed for user `abbe424bcc9941c28494ab68dada13ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:36.775246 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:36.844233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1439/2849] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:36.855758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:36.857669 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:36.919069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb713f9-d348-41df-96e5-01de418cd5e1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:36.922772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:36.923395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:36.923674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:36.923948 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:36.934327 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:36.935768 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae741c18-08f7-4fd3-b631-47126695da98 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:36.946069 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1411/2850] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:38.331610 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:38.393582 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15866e-f034-4e07-b2bd-9fdcc75f781e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:38.398744 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:38.399386 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:38.399664 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:38.399937 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] PATH_INFO: `/v3/users/9c802f8f554b4552a570b7aff583869f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:38.401197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c802f8f554b4552a570b7aff583869f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:38.403110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:38.425757 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:38.452586 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c802f8f554b4552a570b7aff583869f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:38.453284 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c802f8f554b4552a570b7aff583869f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:38.453898 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c802f8f554b4552a570b7aff583869f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:38.461621 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c802f8f554b4552a570b7aff583869f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:38.473257 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c802f8f554b4552a570b7aff583869f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:38.486220 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1440/2851] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:38 2022] DELETE /identity/v3/users/9c802f8f554b4552a570b7aff583869f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:38.491373 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:38.491864 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:38.491976 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:38.511546 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:38.512741 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:38.571799 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1412/2852] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:38.581571 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:38.583260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:38.642035 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13faf3-99c5-4bc7-88f1-7123e3b56ba3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:38.645636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:38.646248 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:38.646527 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:38.646801 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:38.655861 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:38.657359 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:38.668073 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1441/2853] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:38.947326 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:38.948913 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:38.967288 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623afe-1c64-4145-8c01-803032b1da99 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:38.975017 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:38.976472 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:38.976855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:38.977263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] PATH_INFO: `/v3/projects/7e23d1e4f4d44929b09dab573340d6bb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:38.978932 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e23d1e4f4d44929b09dab573340d6bb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:38.981542 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.029793 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e23d1e4f4d44929b09dab573340d6bb', 'request_id': 'req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.035300 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e23d1e4f4d44929b09dab573340d6bb', 'request_id': 'req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.041491 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e23d1e4f4d44929b09dab573340d6bb', 'request_id': 'req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.056682 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] The token cache is being invalidate because project 7e23d1e4f4d44929b09dab573340d6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:39.057035 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.057850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.059713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1413/2854] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:38 2022] DELETE /identity/v3/projects/7e23d1e4f4d44929b09dab573340d6bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:39.063840 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:39.075118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76483d82-2c70-46b7-9265-e9c69d27dc6d service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:39.138081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:39.138730 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.139008 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.139332 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] PATH_INFO: `/v3/users/abbe424bcc9941c28494ab68dada13ae` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.140439 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbe424bcc9941c28494ab68dada13ae)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:39.142387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.186468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:39.194328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbe424bcc9941c28494ab68dada13ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.195115 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbe424bcc9941c28494ab68dada13ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.195994 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbe424bcc9941c28494ab68dada13ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.203685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbe424bcc9941c28494ab68dada13ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.217985 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bc7dbd14-53bb-4f96-ac65-d1987e5c32c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbe424bcc9941c28494ab68dada13ae'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.230866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1442/2855] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:39 2022] DELETE /identity/v3/users/abbe424bcc9941c28494ab68dada13ae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:39.513674 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:39.515458 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:39.531366 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9468b0-b6fd-4a67-8be3-f0b97aedd27c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:39.545433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:39.593083 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:39.593647 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.593928 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.594206 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] PATH_INFO: `/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.595357 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef5a6986c0341fe8a25f7c3071b8dfa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:39.597302 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.644175 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef5a6986c0341fe8a25f7c3071b8dfa', 'request_id': 'req-a6f381e6-de18-439f-9717-af93c201ffdd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.649771 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef5a6986c0341fe8a25f7c3071b8dfa', 'request_id': 'req-a6f381e6-de18-439f-9717-af93c201ffdd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.655736 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef5a6986c0341fe8a25f7c3071b8dfa', 'request_id': 'req-a6f381e6-de18-439f-9717-af93c201ffdd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.670178 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] The token cache is being invalidate because project 6ef5a6986c0341fe8a25f7c3071b8dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:39.670772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.671652 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a6f381e6-de18-439f-9717-af93c201ffdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:39.673433 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1414/2856] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:39 2022] DELETE /identity/v3/projects/6ef5a6986c0341fe8a25f7c3071b8dfa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:39.681847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.682390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.682390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.703149 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:39.703713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:39.765011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1443/2857] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:39.774699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.774989 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.775261 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.797471 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:39.798677 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:39.806785 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1415/2858] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:37:39.811186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:39.821002 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11109-d38f-4b8f-a982-4c68263d7fb9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:39.825450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:39.826059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.826337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.826607 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.827289 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:37:39.827591 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:39.829183 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.843422 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1444/2859] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:37:39.845841 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:39.855836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79af68d-52ce-4cb9-9f5a-5ee0ce05a642 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:39.860627 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:39.861280 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.861564 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.861840 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.862508 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:39.864428 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.891477 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1416/2860] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:39 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:39.896493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:39.906589 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66408-e56a-4df3-ac50-108436d6e1d6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:39.965833 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:39.966453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:39.966734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:39.967010 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:39.967679 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:39.969644 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:39.991793 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1445/2861] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:39 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:39.995966 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.007713 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51e473-d468-4d95-a57a-0f85e886b6f5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.012588 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.013317 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.013596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.013895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.014581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.016232 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.027368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1417/2862] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:40.031384 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.041450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0a5e-25b4-4e10-8876-b34da0311af8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.045982 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.046611 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.046888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.047155 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.047842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.049457 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57bee6-e7be-4aff-97c7-31b5b5578e3b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.061184 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1446/2863] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:40.065820 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.077236 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811620c5-796d-4e59-8bbf-b36907563d34 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.081920 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.083283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.083828 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.084103 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] PATH_INFO: `/v3/projects/5f42eeb77d1b40b1ba2003803f62e6e0/users/28720bd861604f0c8d548de92370d7d0/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.100970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f42eeb77d1b40b1ba2003803f62e6e0, user_id=28720bd861604f0c8d548de92370d7d0, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.103577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.117315 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1418/2864] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:40 2022] PUT /identity/v3/projects/5f42eeb77d1b40b1ba2003803f62e6e0/users/28720bd861604f0c8d548de92370d7d0/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:40.127781 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.128087 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.128365 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.156558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] MFA Rules not processed for user `28720bd861604f0c8d548de92370d7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:40.157802 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:40.171153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:40.225750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1447/2865] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:37:40.230322 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.275291 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:40.293492 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8fec2-a25a-46ea-8b00-340f4b69db3f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.298186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.298801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.299078 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.299375 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.300046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.302596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.329202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1419/2866] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:40 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:40.334042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.345778 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97415b-f44d-4536-a3d5-6e6e323cca02 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.407635 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.408171 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.408452 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.408725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.409426 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.412324 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.433852 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1448/2867] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:40 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:40.438170 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.448961 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9159-a5c4-405d-aa6c-8b3278c5d8da admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.453639 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.454274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.454581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.454844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.455523 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.457962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.468934 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1420/2868] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:40.473895 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.484068 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34af1-3f27-421e-9959-f29f49eeecf0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.489147 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.489821 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.490186 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.490380 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] PATH_INFO: `/v3/projects/1b6d6addbb804a8882dff15f544ecfd5/users/f69b802081574c0bacc9c356beb18dfa/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.505606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d6addbb804a8882dff15f544ecfd5, user_id=f69b802081574c0bacc9c356beb18dfa, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.508260 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.521202 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1449/2869] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:40 2022] PUT /identity/v3/projects/1b6d6addbb804a8882dff15f544ecfd5/users/f69b802081574c0bacc9c356beb18dfa/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:37:40.525295 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.535835 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc26fa-6c31-4f64-a255-a4305563184f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.591680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.592301 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.592575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.592844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.593558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.595141 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d2737-e266-4093-bec1-2d95c5d2c216 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.605448 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1421/2870] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:40.609677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.620350 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255280-a59e-4bc2-a05f-99d054d599ef admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.624967 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.625662 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.625942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.626217 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] PATH_INFO: `/v3/projects/1b6d6addbb804a8882dff15f544ecfd5/users/f69b802081574c0bacc9c356beb18dfa/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.628190 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d6addbb804a8882dff15f544ecfd5, user_id=f69b802081574c0bacc9c356beb18dfa, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.631453 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.641919 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1450/2871] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:40 2022] PUT /identity/v3/projects/1b6d6addbb804a8882dff15f544ecfd5/users/f69b802081574c0bacc9c356beb18dfa/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:40.653120 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.653405 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.653680 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.683426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] MFA Rules not processed for user `f69b802081574c0bacc9c356beb18dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:40.684530 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:40.755260 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1422/2872] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:40.766348 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.768137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:40.826409 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624e9c-b00c-4f80-b0ec-fbbd4128809c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.830031 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.830649 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.831158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.831437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.842437 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.844708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce702542-8e4d-45ba-8d56-377c2bcc58d5 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:40.857282 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1451/2873] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:40.924526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:40.968628 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:40.990709 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836af884-d152-4ee3-bb91-725e2f948864 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:40.995290 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:40.995930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:40.996214 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:40.996489 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] PATH_INFO: `/v3/users/28720bd861604f0c8d548de92370d7d0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:40.997690 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28720bd861604f0c8d548de92370d7d0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:40.999604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:41.047822 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28720bd861604f0c8d548de92370d7d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.048478 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28720bd861604f0c8d548de92370d7d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.055581 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28720bd861604f0c8d548de92370d7d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.056221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28720bd861604f0c8d548de92370d7d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.069007 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28720bd861604f0c8d548de92370d7d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.082276 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1423/2874] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:40 2022] DELETE /identity/v3/users/28720bd861604f0c8d548de92370d7d0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:41.087119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:41.087404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:41.087677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:41.107012 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:41.108207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:41.114636 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:41.172245 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1452/2875] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:41.182778 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:41.184179 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:41.243414 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ba90-9715-4965-b7fe-46c77460b540 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:41.247222 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:41.247844 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:41.248124 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:41.248402 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:41.258655 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:41.260125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:41.271189 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1424/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:41.574213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:41.575839 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:41.589717 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483f52-e942-4618-a94b-3b551f121665 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:41.594725 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:41.595423 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:41.595735 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:41.596011 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] PATH_INFO: `/v3/projects/5f42eeb77d1b40b1ba2003803f62e6e0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:41.597231 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f42eeb77d1b40b1ba2003803f62e6e0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:41.601470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:41.667549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f42eeb77d1b40b1ba2003803f62e6e0', 'request_id': 'req-08941a82-00f9-4618-bfbe-cd46d29e0950'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.673947 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f42eeb77d1b40b1ba2003803f62e6e0', 'request_id': 'req-08941a82-00f9-4618-bfbe-cd46d29e0950'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.683808 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f42eeb77d1b40b1ba2003803f62e6e0', 'request_id': 'req-08941a82-00f9-4618-bfbe-cd46d29e0950'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.696961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] The token cache is being invalidate because project 5f42eeb77d1b40b1ba2003803f62e6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:41.697280 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.697864 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.699404 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1453/2877] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:41 2022] DELETE /identity/v3/projects/5f42eeb77d1b40b1ba2003803f62e6e0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:41.703987 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:41.715249 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37f92-225b-49b3-993b-66a778a8a48b service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:41.772671 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:41.773463 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:41.773758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:41.774015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] PATH_INFO: `/v3/users/f69b802081574c0bacc9c356beb18dfa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:41.775167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69b802081574c0bacc9c356beb18dfa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:41.777174 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:41.778683 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:41.835039 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69b802081574c0bacc9c356beb18dfa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.835725 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69b802081574c0bacc9c356beb18dfa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.843100 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69b802081574c0bacc9c356beb18dfa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.843769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69b802081574c0bacc9c356beb18dfa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.857097 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de8721b4-0028-4b0e-bce6-0e459ff8fa65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69b802081574c0bacc9c356beb18dfa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:41.870696 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1425/2878] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:41 2022] DELETE /identity/v3/users/f69b802081574c0bacc9c356beb18dfa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:37:42.148652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.150131 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:42.165360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941a82-00f9-4618-bfbe-cd46d29e0950 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.225842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.226495 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.226773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.227045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] PATH_INFO: `/v3/projects/1b6d6addbb804a8882dff15f544ecfd5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.228213 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6d6addbb804a8882dff15f544ecfd5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.230177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.270655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:42.280880 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6d6addbb804a8882dff15f544ecfd5', 'request_id': 'req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:42.286427 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6d6addbb804a8882dff15f544ecfd5', 'request_id': 'req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:42.294681 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6d6addbb804a8882dff15f544ecfd5', 'request_id': 'req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:42.306643 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] The token cache is being invalidate because project 1b6d6addbb804a8882dff15f544ecfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:42.306932 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:42.307575 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-964b9652-a6b7-4f42-baa4-0cce9f7e0b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:42.309104 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1454/2879] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:42 2022] DELETE /identity/v3/projects/1b6d6addbb804a8882dff15f544ecfd5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:42.314041 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.314395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.314685 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.335574 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:42.336782 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:42.396959 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1426/2880] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:42.405708 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.405995 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.406281 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.426978 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:42.428285 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:42.436482 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1455/2881] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:42.440794 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.450895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f79a-3f75-42f9-aa6e-d484adae2fff None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.455484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.456095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.456370 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.457461 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.457570 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:37:42.457855 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.459723 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.479675 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1427/2882] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:37:42.484042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.494336 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae756d8-8fff-42c1-b0a3-c06611eaa83a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.499503 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.500119 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.500397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.500674 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.501385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.503270 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.532327 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1456/2883] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:42.538308 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.549294 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875175-1609-4674-849f-ceeda87ba84c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.609084 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.609711 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.609986 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.610254 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.610936 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.612897 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.625274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:42.642117 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1428/2884] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:42.643377 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.653777 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0765-7eb5-4440-a418-7b510f00c8d7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.658357 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.658954 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.659233 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.659569 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.660734 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.662337 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.672446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1457/2885] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:42.677059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.687110 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b14382-787b-42fa-a663-cff5c2b7fd55 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.691930 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.692529 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.692804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.693107 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.693791 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.695376 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9555ed-5593-4719-a80d-30d41c9adaf2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.706167 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1429/2886] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:37:42.711459 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.721292 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68068b1f-c1b2-4c8f-beec-131c63a70d42 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.726560 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.727210 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.727486 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.727784 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] PATH_INFO: `/v3/projects/cc17c13087634d92854d03ec61681a6a/users/23cff648699149e5a2e79e2fad020a0a/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.742832 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc17c13087634d92854d03ec61681a6a, user_id=23cff648699149e5a2e79e2fad020a0a, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.745463 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.758853 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1458/2887] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:42 2022] PUT /identity/v3/projects/cc17c13087634d92854d03ec61681a6a/users/23cff648699149e5a2e79e2fad020a0a/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:42.769199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.770125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.770368 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.798095 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] MFA Rules not processed for user `23cff648699149e5a2e79e2fad020a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:42.799298 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:42.863962 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1430/2888] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:42.868468 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.930045 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576a989-e165-4c13-9de8-9d8deb500ef0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:42.934677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:42.935295 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:42.935573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:42.935847 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:42.936516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:42.938435 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:42.966739 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1459/2889] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:42.970819 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:42.982526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976a13-f989-44c0-b06a-2e6a73e78f52 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.038656 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.039186 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.039466 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.039738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.040398 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.042339 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.063836 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1431/2890] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:42 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:43.068375 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.078637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a0a71-6e84-4511-836e-0884af97b4df admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.083234 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.084110 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.084388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.084661 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.085381 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.086961 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.098085 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1460/2891] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:43.102256 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.112379 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00677-6d39-41ea-a02d-fd2c83b4e003 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.117953 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.118626 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.118905 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.119180 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] PATH_INFO: `/v3/projects/af24061a41764de398a3fdc8c3a029de/users/dfa7842f25794669b2a877d52174e1af/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.135220 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af24061a41764de398a3fdc8c3a029de, user_id=dfa7842f25794669b2a877d52174e1af, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.138995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.152182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1432/2892] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:43 2022] PUT /identity/v3/projects/af24061a41764de398a3fdc8c3a029de/users/dfa7842f25794669b2a877d52174e1af/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:43.156209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.167448 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddca2c-cfe1-4d27-9355-df8093371dd4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.202671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:43.230059 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.230682 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.230960 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.231235 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.231925 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.233992 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c3c54-d3f5-49b0-974f-fdda68ecbb4c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.246502 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1461/2893] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:43.250699 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.261823 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be912b5-d6ec-44f7-b9f6-2b236e32f417 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.266613 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.267283 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.267559 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.267833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] PATH_INFO: `/v3/projects/af24061a41764de398a3fdc8c3a029de/users/dfa7842f25794669b2a877d52174e1af/roles/caebc9bcf6f048af9c4ccff5ee4b50ac` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.270447 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af24061a41764de398a3fdc8c3a029de, user_id=dfa7842f25794669b2a877d52174e1af, role_id=caebc9bcf6f048af9c4ccff5ee4b50ac)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.273130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.283560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1433/2894] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:43 2022] PUT /identity/v3/projects/af24061a41764de398a3fdc8c3a029de/users/dfa7842f25794669b2a877d52174e1af/roles/caebc9bcf6f048af9c4ccff5ee4b50ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:43.294515 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.294743 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.295024 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.324000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] MFA Rules not processed for user `dfa7842f25794669b2a877d52174e1af`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:43.325253 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:43.396120 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1462/2895] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:43.407742 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.409539 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:43.442958 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:43.471594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d4647-9536-485f-a658-3d44f894c52a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.475898 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.476526 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.476805 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.477114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.486537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.488003 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.497644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1434/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:43.571655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.581308 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387d440-e3aa-49e0-8b48-8b32c609ec3b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.586291 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:43.586917 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:43.587195 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:43.587466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:43.645081 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:43.646787 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5679ec-781e-4f92-856d-577c24977a7b service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:43.655742 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1463/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:43.929397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:43.995076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f120a59-f854-4afa-8595-b679cfe85575 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:43.999567 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:44.000199 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:44.000470 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:44.000738 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] PATH_INFO: `/v3/users/23cff648699149e5a2e79e2fad020a0a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:44.001910 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cff648699149e5a2e79e2fad020a0a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:44.004032 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:44.051337 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cff648699149e5a2e79e2fad020a0a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.052270 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cff648699149e5a2e79e2fad020a0a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.059106 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cff648699149e5a2e79e2fad020a0a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.059739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cff648699149e5a2e79e2fad020a0a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.071849 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cff648699149e5a2e79e2fad020a0a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.085908 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1435/2898] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:43 2022] DELETE /identity/v3/users/23cff648699149e5a2e79e2fad020a0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:44.090573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:44.090909 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:44.091259 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:44.110968 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:44.112176 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:44.160416 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:44.171714 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1464/2899] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:44.182091 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:44.183484 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:44.241644 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:44.246184 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f428-834a-4b49-98cb-94203865e989 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:44.253872 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:44.254758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:44.256202 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:44.256698 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:44.267076 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:44.268506 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:44.278198 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1436/2900] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 07:37:44.560032 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:44.561561 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:44.574657 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceec27a-5b57-4d55-9572-b7697dea4d31 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:44.579693 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:44.580342 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:44.580614 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:44.580894 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] PATH_INFO: `/v3/projects/cc17c13087634d92854d03ec61681a6a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:44.582684 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc17c13087634d92854d03ec61681a6a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:44.584835 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:44.635376 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc17c13087634d92854d03ec61681a6a', 'request_id': 'req-994d6b27-bed3-4687-b482-cf9d0016b11b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.640848 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc17c13087634d92854d03ec61681a6a', 'request_id': 'req-994d6b27-bed3-4687-b482-cf9d0016b11b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.649699 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc17c13087634d92854d03ec61681a6a', 'request_id': 'req-994d6b27-bed3-4687-b482-cf9d0016b11b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.661807 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] The token cache is being invalidate because project cc17c13087634d92854d03ec61681a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:44.662094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.662767 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.664272 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1465/2901] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:44 2022] DELETE /identity/v3/projects/cc17c13087634d92854d03ec61681a6a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:44.668516 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:44.682964 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b893653-45ae-424d-9caa-5de84df67249 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:44.742122 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:44.742765 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:44.743046 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:44.743316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] PATH_INFO: `/v3/users/dfa7842f25794669b2a877d52174e1af` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:44.744473 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa7842f25794669b2a877d52174e1af)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:44.746411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:44.794282 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa7842f25794669b2a877d52174e1af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.795061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa7842f25794669b2a877d52174e1af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.802537 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa7842f25794669b2a877d52174e1af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.803197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa7842f25794669b2a877d52174e1af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.815321 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-64a6fef1-44af-4ece-80cb-122c5b427936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa7842f25794669b2a877d52174e1af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:44.829195 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1437/2902] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:44 2022] DELETE /identity/v3/users/dfa7842f25794669b2a877d52174e1af => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:45.111865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.114236 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:45.127027 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6b27-bed3-4687-b482-cf9d0016b11b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.187107 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.187671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.187942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.188212 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] PATH_INFO: `/v3/projects/af24061a41764de398a3fdc8c3a029de` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.189407 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af24061a41764de398a3fdc8c3a029de)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.191899 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.239720 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af24061a41764de398a3fdc8c3a029de', 'request_id': 'req-824090ca-0576-4406-8b6a-2b8b8485e60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:45.245446 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af24061a41764de398a3fdc8c3a029de', 'request_id': 'req-824090ca-0576-4406-8b6a-2b8b8485e60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:45.253159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af24061a41764de398a3fdc8c3a029de', 'request_id': 'req-824090ca-0576-4406-8b6a-2b8b8485e60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:45.265387 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] The token cache is being invalidate because project af24061a41764de398a3fdc8c3a029de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:45.265675 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:45.266343 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-824090ca-0576-4406-8b6a-2b8b8485e60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:45.267878 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1466/2903] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:45 2022] DELETE /identity/v3/projects/af24061a41764de398a3fdc8c3a029de => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:45.273442 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.274015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.274015 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.294869 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:45.296140 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:45.358406 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1438/2904] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:45.366986 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.367269 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.367547 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.387888 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:45.389106 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:45.397299 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1467/2905] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:45.401517 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.412316 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1f1d-7544-4b5b-85af-dc7c6ec83f9f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.417404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.418047 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.418325 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.418604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.419297 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:37:45.419604 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.421263 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.429057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:45.435876 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1439/2906] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:37:45.440209 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.450555 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93888a-2582-4cb4-83e7-24bad417e89a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.451385 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:45.459388 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.459990 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.460517 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.461000 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.462177 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.464118 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.493013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1468/2907] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:45 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:45.497340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.507212 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a1d-ed81-4f3a-98de-130959d0d6e9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.565182 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.565801 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.566150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.566943 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.567612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.569558 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.591049 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1440/2908] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:45.595268 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.606467 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79ded-fcc4-4361-a850-c37820a5166d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.611153 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.611774 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.612055 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.612328 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.613654 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.615250 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.625813 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1469/2909] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 07:37:45.630059 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.640057 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7946cf3-7f5e-4b67-bcc4-d6ce3a778fa6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.644761 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.645583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.645859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.646130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.646813 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.648411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea216dc-1383-4ffd-b323-bc064f4a407b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.659718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1441/2910] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:45.664638 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.675139 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c89aa-e8cc-42ce-8691-fd30bbdb9f0d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.680395 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.681094 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.681374 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.681677 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] PATH_INFO: `/v3/projects/c620e7d635c84703a39662e3a4f4fb32/users/13c882de0fde4050b9528537bdd968b7/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.697080 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c620e7d635c84703a39662e3a4f4fb32, user_id=13c882de0fde4050b9528537bdd968b7, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.699750 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.714158 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1470/2911] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:45 2022] PUT /identity/v3/projects/c620e7d635c84703a39662e3a4f4fb32/users/13c882de0fde4050b9528537bdd968b7/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:45.725285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.725571 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.725850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.754901 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] MFA Rules not processed for user `13c882de0fde4050b9528537bdd968b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:45.756118 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:45.821850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1442/2912] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:45.834037 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:45.835707 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:45.892945 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d030d-ce03-4618-8da9-45dcd81345dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:45.897251 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:45.897872 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:45.898150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:45.898419 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:45.907200 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:45.908618 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a128a-5a54-438d-8336-135588d73c1a service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:45.918242 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1471/2913] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:45.937773 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.001586 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb08dc-3372-4c92-a359-6b9e0e090890 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.006633 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.007272 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.007553 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.007830 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] PATH_INFO: `/v3/users/13c882de0fde4050b9528537bdd968b7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.009019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c882de0fde4050b9528537bdd968b7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.010933 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.016395 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:46.058833 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c882de0fde4050b9528537bdd968b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.059594 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c882de0fde4050b9528537bdd968b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.067340 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c882de0fde4050b9528537bdd968b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.068114 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c882de0fde4050b9528537bdd968b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.079992 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c882de0fde4050b9528537bdd968b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.094356 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1443/2914] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:37:45 2022] DELETE /identity/v3/users/13c882de0fde4050b9528537bdd968b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:46.099142 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.099430 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.099713 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.118842 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:46.120077 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:46.178716 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1472/2915] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:46.188426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.189862 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:46.249125 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fdedf-dbfa-4d3f-b407-c055322621e2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.252826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.253426 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.254285 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.254560 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.263772 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.265233 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59ad8c-83fa-46ea-8d0f-f96a1597a929 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.275383 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1444/2916] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:46.548619 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.551150 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:46.563745 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f2a3-7ca3-4f0c-92a2-1bda557ae63b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.569573 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.570237 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.570516 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.570786 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] PATH_INFO: `/v3/projects/c620e7d635c84703a39662e3a4f4fb32` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.572060 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c620e7d635c84703a39662e3a4f4fb32)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.574113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.626558 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:46.632013 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c620e7d635c84703a39662e3a4f4fb32', 'request_id': 'req-c37a17d3-eb40-4a57-8aba-0c7fa151f704'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.638974 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c620e7d635c84703a39662e3a4f4fb32', 'request_id': 'req-c37a17d3-eb40-4a57-8aba-0c7fa151f704'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.646207 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c620e7d635c84703a39662e3a4f4fb32', 'request_id': 'req-c37a17d3-eb40-4a57-8aba-0c7fa151f704'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.657585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] The token cache is being invalidate because project c620e7d635c84703a39662e3a4f4fb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:37:46.657865 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.658493 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c37a17d3-eb40-4a57-8aba-0c7fa151f704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:37:46.660137 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1473/2917] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:37:46 2022] DELETE /identity/v3/projects/c620e7d635c84703a39662e3a4f4fb32 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:37:46.665123 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.665435 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.665714 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.686536 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:46.687730 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:46.749509 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1445/2918] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:46.759390 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.759823 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.760103 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.781860 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:46.783070 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:46.791057 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1474/2919] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 07:37:46.795431 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.805815 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9dd93-67d3-49f4-ad8a-bb520308c2c0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.810268 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.810877 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.811150 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.811422 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.812102 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 07:37:46.812397 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.814019 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.826499 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1446/2920] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 07:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 07:37:46.831015 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.840685 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4598fd-c196-4567-96be-82a4f81e953d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.845288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.845904 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.846309 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.846471 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.847113 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.849718 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.880772 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1475/2921] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 07:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 07:37:46.885061 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.895446 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693097-ce1f-44b2-9a1b-ef683b468819 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:46.906970 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:46.955378 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:46.955995 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:46.956274 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:46.956766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:46.957601 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:46.959784 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:46.981596 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1447/2922] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 07:37:46 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 07:37:46.985915 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:46.996972 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb912-76a6-416c-a3bc-b88d9a5d6fe3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:47.001538 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:47.002152 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.002432 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.002700 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.003382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:47.005518 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:47.015658 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1476/2923] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:47.020501 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:47.030780 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92830f-34a8-4407-a0d4-ce32c111f153 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:47.035718 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:47.036331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.036614 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.036890 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.037616 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:47.039217 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f4b7-a9bc-47d8-aace-31c6b9779ad9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:47.049991 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1448/2924] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 07:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 07:37:47.054100 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:47.064042 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c525a-dc29-4d78-aada-f201a68949f2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:47.069160 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:47.069816 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.070092 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.070364 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] PATH_INFO: `/v3/projects/0c74f94962a642e1af588ef0f58cbb09/users/804b477315d241b4aa84b0f082b54218/roles/89195211fe574d2f96f793a39364ed4d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.086830 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c74f94962a642e1af588ef0f58cbb09, user_id=804b477315d241b4aa84b0f082b54218, role_id=89195211fe574d2f96f793a39364ed4d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:47.089549 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:47.102666 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1477/2925] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 07:37:47 2022] PUT /identity/v3/projects/0c74f94962a642e1af588ef0f58cbb09/users/804b477315d241b4aa84b0f082b54218/roles/89195211fe574d2f96f793a39364ed4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:37:47.107577 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e308a-0749-4b9d-aa6d-78f6a32c9559 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.107859 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e308a-0749-4b9d-aa6d-78f6a32c9559 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.108130 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e308a-0749-4b9d-aa6d-78f6a32c9559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.127703 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a79e308a-0749-4b9d-aa6d-78f6a32c9559 None None] MFA Rules not processed for user `ab9d252f59de4268acb7a07e5f3ccbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:47.129789 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a79e308a-0749-4b9d-aa6d-78f6a32c9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:47.189552 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1449/2926] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:47.199687 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:47.201444 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:47.259128 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0bd8-1aa8-459b-be4e-574939c6c271 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:47.262729 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d27ceb5baf4b71b2ae60975e787151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:47.263345 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.263625 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.263890 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.273168 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:47.274588 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:47.283866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1478/2927] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:47.934058 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3139d-0df0-4b22-a1bc-97d540a48b20 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:47.934739 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3139d-0df0-4b22-a1bc-97d540a48b20 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:47.934826 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3139d-0df0-4b22-a1bc-97d540a48b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:47.968369 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3fd3139d-0df0-4b22-a1bc-97d540a48b20 None None] MFA Rules not processed for user `804b477315d241b4aa84b0f082b54218`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:47.969643 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3fd3139d-0df0-4b22-a1bc-97d540a48b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:48.043240 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1450/2928] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:48.054637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:37:48.056161 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:48.119360 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b74aa-91bc-47b8-a088-2e4da1cf5fbf service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:37:48.123159 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7cd29afc2344ecbe9557ecb43b2801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:37:48.123783 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:48.124065 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:48.124361 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:48.135397 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:37:48.136844 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a9ef0-33c2-46dc-bd00-dc348dda2408 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:37:48.147317 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1479/2929] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:37:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:37:49.553068 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9620-cb84-44dc-b7dc-f8b1df8381aa None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:37:49.553576 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9620-cb84-44dc-b7dc-f8b1df8381aa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:37:49.553658 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9620-cb84-44dc-b7dc-f8b1df8381aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:37:49.572575 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-079b9620-cb84-44dc-b7dc-f8b1df8381aa None None] MFA Rules not processed for user `804b477315d241b4aa84b0f082b54218`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:37:49.573807 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-079b9620-cb84-44dc-b7dc-f8b1df8381aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:37:49.580710 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1451/2930] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:37:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:37:58.142264 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:37:59.567203 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:38:03.682382 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:03.682905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:03.682905 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:03.702466 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] MFA Rules not processed for user `804b477315d241b4aa84b0f082b54218`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:38:03.703500 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:03.711288 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1480/2931] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 07:38:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:38:13.696765 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:38:22.680177 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518be0-6e04-4e46-9a89-990b22580bd9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:22.680679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518be0-6e04-4e46-9a89-990b22580bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:22.680679 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4518be0-6e04-4e46-9a89-990b22580bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:22.744583 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e4518be0-6e04-4e46-9a89-990b22580bd9 None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:38:22.745850 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e4518be0-6e04-4e46-9a89-990b22580bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:22.814060 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1452/2932] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 07:38:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:38:22.863410 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:38:22.864942 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:22.958882 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fa6a5-5bc9-49a0-b7c6-d82ef69b332a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:38:22.963999 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:38:22.964624 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:22.964902 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:22.965203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:22.974703 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:38:22.976314 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:38:22.985552 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1481/2933] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:38:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 07:38:32.811006 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=44 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:38:32.981866 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=41 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:38:38.202895 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:38.203404 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:38.203496 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:38.223561 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] MFA Rules not processed for user `ad7f47c74bc54f67bde9d523cd0b4936`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 07:38:38.224766 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:38.232522 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1453/2934] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 07:38:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 07:38:38.245670 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:38:38.257595 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa50a-b1f6-4f3c-a2de-1b43b048c168 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:38:38.262773 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df74ba7216d64aa081a8ce2fbccb7b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:38:38.263389 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:38.263671 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:38.263944 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:38.272156 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:38:38.273752 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:38:38.281740 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1482/2935] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 07:38:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 07:38:40.162483 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:38:40.163955 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:40.227383 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:38:40.240169 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538ea2-809c-48b7-a7f3-333f0cc4af9f service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:38:40.244197 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46546b3-5418-4348-9bfe-3cca676df80a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:38:40.245313 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:38:40.245965 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:40.246241 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:40.246512 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] PATH_INFO: `/v3/users/804b477315d241b4aa84b0f082b54218` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:40.247655 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=804b477315d241b4aa84b0f082b54218)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:38:40.249606 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:38:40.249769 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:38:40.250389 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:40.250733 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:40.252121 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:40.254108 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:38:40.266331 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:38:40.268993 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:38:40.279879 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1454/2936] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:38:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:38:40.300154 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804b477315d241b4aa84b0f082b54218'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.300918 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804b477315d241b4aa84b0f082b54218'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.301567 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804b477315d241b4aa84b0f082b54218'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.308491 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804b477315d241b4aa84b0f082b54218'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.322749 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804b477315d241b4aa84b0f082b54218'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.337585 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1483/2937] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 07:38:40 2022] DELETE /identity/v3/users/804b477315d241b4aa84b0f082b54218 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 07:38:40.525221 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:38:40.538758 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6644728-5818-4a90-a03b-b9c67a3c3bd1 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:38:40.599411 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9d252f59de4268acb7a07e5f3ccbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cb3b87528e24f6496c89253b8f1df0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:38:40.600086 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:38:40.600355 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:38:40.600612 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] PATH_INFO: `/v3/projects/0c74f94962a642e1af588ef0f58cbb09` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:38:40.601804 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c74f94962a642e1af588ef0f58cbb09)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:38:40.603707 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:38:40.650264 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c74f94962a642e1af588ef0f58cbb09', 'request_id': 'req-4345d74e-2660-415d-b21e-2ff481d856c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.656416 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c74f94962a642e1af588ef0f58cbb09', 'request_id': 'req-4345d74e-2660-415d-b21e-2ff481d856c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.663176 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c74f94962a642e1af588ef0f58cbb09', 'request_id': 'req-4345d74e-2660-415d-b21e-2ff481d856c1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.683848 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] The token cache is being invalidate because project 0c74f94962a642e1af588ef0f58cbb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 07:38:40.684133 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.684809 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4345d74e-2660-415d-b21e-2ff481d856c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 07:38:40.686364 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1455/2938] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 07:38:40 2022] DELETE /identity/v3/projects/0c74f94962a642e1af588ef0f58cbb09 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 07:38:50.332637 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:38:50.676081 dv-cinder-826608-7-iscsi devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:40:18.174689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 07:40:18.177044 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:40:18.248146 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef0cd-6af8-4355-9185-583a1e47d03d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 07:40:18.311470 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11759ed684c74cadada92aef1f6d0e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a34838e7a54fdcbcb3c4ba4b0d37b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 07:40:18.312096 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 07:40:18.312378 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 07:40:18.312652 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 07:40:18.314450 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 07:40:18.330203 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 07:40:18.333197 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3c151-d878-498e-b2e3-fe34ce3983f8 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 07:40:18.346689 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1484/2939] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 07:40:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 07:40:28.341398 dv-cinder-826608-7-iscsi devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=58 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}